00000001:02000400:0.0F:1784186278.873202:0:2962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1784186301.214316:0:3182:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1784186303.041588:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 567 MB/s 00000001:01000000:3.0:1784186303.294487:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 652 MB/s 00000001:01000000:3.0:1784186303.544543:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3295 MB/s 00000020:02000000:0.0:1784186304.397425:0:3274:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_g9958c38 00000400:02000000:2.0F:1784186305.004140:0:3290:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.201.131@tcp [8/256/0/180] 00008000:02000000:3.0:1784186308.811648:0:3439:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1784186359.622366:0:5239:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1784186370.982819:0:5763:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784186370.982825:0:5763:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1784186370.983008:0:5763:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000048f1f68a 00000080:02000400:3.0:1784186370.983019:0:5763:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1784186370.990737:0:5763:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1784186370.990752:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784186370.991000:0:5763:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000c7d27a53) 00000020:00000080:0.0:1784186370.991021:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784186371.015754:0:5763:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1784186371.016201:0:5763:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1784186371.063730:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784186371.063774:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784186371.063809:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784186371.063874:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784186371.063902:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784186371.064539:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784186371.064547:0:5763:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784186371.064560:0:5763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d18dc9 00000020:01000004:3.0:1784186371.064567:0:5763:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1784186371.064572:0:5763:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784186371.064576:0:5763:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000048f1f68a from MGS 00000020:01000004:3.0:1784186371.064580:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784186371.064599:0:5763:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000007865f3c7) 00000020:00000080:3.0:1784186371.064610:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784186371.064705:0:5763:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000048f1f68a from MGS, refs=2 00080000:01000000:3.0:1784186371.064711:0:5763:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784186371.064715:0:5763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d18dd7 00000100:00100000:3.0:1784186371.064814:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784186371.065496:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784186371.065502:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1784186371.067404:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1784186371.067415:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784186371.068172:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784186371.068513:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784186371.068519:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784186371.075015:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1784186371.075030:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1784186371.080738:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1784186371.080751:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1784186371.089471:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186371.089476:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186371.089478:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186371.090173:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186371.090176:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186371.090178:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186371.090904:0:5763:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784186371.106965:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1784186371.341005:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2071 MB/s 00000001:01000000:1.0:1784186371.590600:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2339 MB/s 00000001:01000000:0.0:1784186371.842641:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 500 MB/s 00000001:01000000:3.0:1784186372.095096:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 428 MB/s 00010000:00010000:1.0:1784186372.099791:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1784186372.112138:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1784186372.142160:0:5763:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1784186372.142801:0:5763:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784186372.142805:0:5763:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1784186372.146880:0:5773:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784186372.146992:0:5763:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784186372.147046:0:5763:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1784186372.147344:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1784186372.147373:0:5763:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784186372.147718:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784186372.147868:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784186372.147874:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1784186372.151605:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1784186372.151617:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784186372.170588:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784186372.170602:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784186372.171190:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784186372.171211:0:5763:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.131@tcp' 00000020:01000004:3.0:1784186372.171213:0:5763:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784186372.171264:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.131@tcp (typ=mgc) 00000020:00000080:3.0:1784186372.171275:0:5763:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.131@tcp (00000000e678fe67) 00000020:00000080:3.0:1784186372.171292:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1784186372.171365:0:5763:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bc3627eb@MGC192.168.201.131@tcp: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1784186372.171538:0:5763:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.131@tcp-0 is initialized 00000040:01000000:3.0:1784186372.171543:0:5763:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 1 is initialized 00000100:00080000:1.0:1784186372.173084:0:5778:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1784186372.181726:0:5780:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1784186372.181833:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.131@tcp (uuid fab6759c-e30b-4013-88b9-0b4d132afa93) 00000020:00000080:3.0:1784186372.181859:0:5763:0:(genops.c:1406:class_connect()) connect: client fab6759c-e30b-4013-88b9-0b4d132afa93, cookie 0x55bc3e8c99d18de5 00000100:00080000:3.0:1784186372.181872:0:5763:0:(import.c:510:import_select_connection()) MGC192.168.201.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784186372.181878:0:5763:0:(import.c:624:import_select_connection()) MGC192.168.201.131@tcp: import 00000000bc3627eb using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1784186372.181937:0:5763:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002fb0b0f0 x1870854937903232/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784186372.181966:0:5763:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fab6759c-e30b-4013-88b9-0b4d132afa93->MGS 00000100:00100000:2.0:1784186372.182099:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fb0b0f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fab6759c-e30b-4013-88b9-0b4d132afa93:3305:1870854937903232:0@lo:250: 00000100:00100000:2.0:1784186372.182207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186372.185712:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937903232 00000100:00100000:0.0:1784186372.185728:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937903232 00000100:00100000:0.0:1784186372.185787:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784186372.185793:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000970487c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1870854937903232:12345-0@lo:250: 00010000:00080000:0.0:1784186372.185821:0:5774:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from fab6759c-e30b-4013-88b9-0b4d132afa93@0@lo t0 exp 0000000000000000 cur 150 last 0 00000020:00000080:0.0:1784186372.185861:0:5774:0:(genops.c:1406:class_connect()) connect: client fab6759c-e30b-4013-88b9-0b4d132afa93, cookie 0x55bc3e8c99d18dec 00000100:00080000:0.0:1784186372.185991:0:5774:0:(import.c:65:import_set_state_nolock()) 00000000155e079f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784186372.186075:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000970487c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+5:3305:x1870854937903232:12345-0@lo:250: Request processed in 280us (3867us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186372.186082:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784186372.186143:0:3305:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1784186372.186152:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.131@tcp: connect to target with instance 0 00000100:00080000:0.0:1784186372.186158:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784186372.186162:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784186372.186164:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000bc3627eb MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784186372.186167:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784186372.186173:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784186372.186177:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fb0b0f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fab6759c-e30b-4013-88b9-0b4d132afa93:3305:1870854937903232:0@lo:250: 00000020:01000004:3.0:1784186372.187480:0:5763:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1784186372.188522:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1784186372.188541:0:5763:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d97c710c) 00000020:00000080:0.0:1784186372.188559:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1784186372.218020:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784186372.218233:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1784186372.218239:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1784186372.219227:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1784186372.219235:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784186372.220262:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1784186372.220271:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1784186372.221069:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784186372.221251:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1784186372.221257:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1784186372.222618:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1784186372.222629:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1784186372.262417:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784186372.262886:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1784186372.262893:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1784186372.263892:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1784186372.263902:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1784186372.264638:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784186372.265103:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1784186372.265119:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784186372.265653:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784186372.265661:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784186372.266272:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784186372.266428:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784186372.266433:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784186372.266990:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784186372.266998:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784186372.268328:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784186372.269091:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784186372.269097:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784186372.269643:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784186372.269649:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784186372.315128:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784186372.315958:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784186372.315965:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1784186372.318370:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784186372.318392:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784186372.325533:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784186372.325553:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1784186372.331757:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1784186372.331793:0:5763:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1784186372.331799:0:5763:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1784186372.331933:0:5763:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784186372.331968:0:5763:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.131@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1784186372.331973:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784186372.331974:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784186372.331976:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784186372.331977:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784186372.331978:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784186372.331979:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784186372.331980:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784186372.331981:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784186372.331982:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784186372.331984:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784186372.331985:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784186372.331987:0:5763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784186372.331989:0:5763:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1784186372.331991:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784186372.331992:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784186372.331993:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784186372.331994:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784186372.332000:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784186372.332001:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784186372.332002:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784186372.332002:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784186372.332003:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784186372.332004:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784186372.332005:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784186372.332005:0:5763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784186372.332042:0:5763:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784186372.332062:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c22ff432 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937903360:0@lo:253: 00000100:00100000:1.0:1784186372.332152:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186372.332211:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 000000001687f574 going to sleep for 11 seconds 00000100:00100000:0.0:1784186372.332391:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937903360 00000100:00100000:0.0:1784186372.332399:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937903360 00000100:00100000:0.0:1784186372.332481:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784186372.332489:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b06bee1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+5:5763:x1870854937903360:12345-0@lo:253: 20000000:01000000:0.0:1784186372.332538:0:5777:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784186372.332541:0:5777:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1784186372.336023:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784186372.336098:0:5777:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1784186372.336419:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784186372.341438:0:5799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1784186372.342340:0:5777:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784186372.342345:0:5777:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1784186372.342350:0:5777:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1784186372.342353:0:5777:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1784186372.342367:0:5777:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1784186372.342596:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784186372.342828:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1784186372.342841:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784186372.342880:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1784186372.342929:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1784186372.342960:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1784186372.343032:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1784186372.343040:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1784186372.343087:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1784186372.343094:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1784186372.343118:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1784186372.343123:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1784186372.343146:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1784186372.343192:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1784186372.343230:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1784186372.343234:0:5777:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1784186372.343244:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784186372.343404:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1784186372.343413:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784186372.343475:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1784186372.343507:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1784186372.343546:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1784186372.343556:0:5777:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1784186372.343625:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1784186372.343633:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1784186372.343667:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1784186372.343695:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1784186372.343721:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1784186372.343731:0:5777:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1784186372.343812:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1784186372.343820:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1784186372.343845:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1784186372.343871:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1784186372.344001:0:5777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1784186372.344039:0:5777:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1784186372.344046:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1784186372.346054:0:5800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1784186372.346629:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1784186372.346657:0:5777:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.131@tcp for mdt 20000000:01000000:1.0:1784186372.346659:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:1.0:1784186372.346694:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1784186372.346702:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1784186372.346732:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1784186372.346740:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:1.0:1784186372.346796:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1784186372.346807:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1784186372.346838:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1784186372.346873:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1784186372.346935:0:5777:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784186372.346939:0:5777:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1784186372.346944:0:5777:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1784186372.346951:0:5777:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1784186372.350025:0:5801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1784186372.350177:0:5777:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1784186372.360338:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1784186372.360397:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1784186372.360663:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1784186372.360686:0:5777:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1784186372.360690:0:5777:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1784186372.360694:0:5777:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1784186372.360708:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784186372.360720:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784186372.360752:0:5777:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784186372.360754:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1784186372.362651:0:5802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1784186372.363673:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1784186372.363722:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1784186372.363803:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1784186372.363819:0:5777:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784186372.363822:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1784186372.364722:0:5803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1784186372.364997:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1784186372.365040:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1784186372.365106:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1784186372.365128:0:5777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784186372.365131:0:5777:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1784186372.365137:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784186372.365163:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18dfa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.365180:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18dfa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.365190:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18dfa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.365195:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18dfa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.365201:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18dfa lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.365207:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18dfa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.365213:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000072ae70f1 already unused, calling callback (000000000e3bc0e5) 00010000:00010000:1.0:1784186372.365217:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18dfa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.365223:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18dfa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.365235:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18dfa lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.365242:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18dfa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.365256:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18dfa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784186372.365271:0:5777:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784186372.641806:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b06bee1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+5:5763:x1870854937903360:12345-0@lo:253: Request processed in 309310us (309647us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186372.641826:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784186372.641940:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c22ff432 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937903360:0@lo:253: 10000000:01000000:2.0:1784186372.641955:0:5763:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784186372.641958:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784186372.641960:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784186372.641961:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186372.641962:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1784186372.641963:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186372.641964:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186372.641966:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784186372.641967:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784186372.641969:0:5763:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784186372.641970:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186372.641972:0:5763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784186372.641992:0:5763:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000048f1f68a from lustre-MDT0000 10000000:01000000:2.0:1784186372.642038:0:5763:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784186372.642041:0:5763:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784186372.642046:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b9fc7763380 10000000:01000000:2.0:1784186372.642058:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784186372.642065:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b9fc7763380 from 1 10000000:01000000:2.0:1784186372.642068:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784186372.642108:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 0000000081ba2761/0x55bc3e8c99d18e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186372.642119:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 0000000081ba2761/0x55bc3e8c99d18e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186372.642127:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 0000000081ba2761/0x55bc3e8c99d18e01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186372.642144:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009f050252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937903488:0@lo:101: 00000100:00100000:2.0:1784186372.642183:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186372.642354:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b47916e3 going to sleep for 11 seconds 00000100:00100000:1.0:1784186372.642538:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937903488 00000100:00100000:1.0:1784186372.642545:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937903488 00000100:00100000:1.0:1784186372.642633:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784186372.642642:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bce7e725 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+5:5763:x1870854937903488:12345-0@lo:101: 00010000:00010000:1.0:1784186372.642654:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186372.642666:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18e08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18e01 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.642688:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e01 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.642697:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072ae70f1/0x55bc3e8c99d18e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e01 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186372.642706:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072ae70f1, rc 0) 00000100:00100000:1.0:1784186372.642747:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bce7e725 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+6:5763:x1870854937903488:12345-0@lo:101: Request processed in 108us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186372.642761:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784186372.642829:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009f050252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937903488:0@lo:101: 00010000:00010000:3.0:1784186372.642853:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 0000000081ba2761/0x55bc3e8c99d18e01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.642861:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 0000000081ba2761/0x55bc3e8c99d18e01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186372.642905:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004c0842c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937903616:0@lo:501: 00000100:00100000:3.0:1784186372.642954:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186372.643116:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dae7c709 going to sleep for 11 seconds 00000100:00100000:0.0:1784186372.643153:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937903616 00000100:00100000:0.0:1784186372.643157:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937903616 00000100:00100000:0.0:1784186372.643178:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784186372.643183:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d28ac47e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+6:5763:x1870854937903616:12345-0@lo:501: 00000100:00100000:0.0:1784186372.643428:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d28ac47e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+6:5763:x1870854937903616:12345-0@lo:501: Request processed in 245us (474us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784186372.643464:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784186372.643596:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004c0842c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937903616:0@lo:501: 10000000:01000000:3.0:1784186372.643623:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784186372.643644:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 0000000081ba2761/0x55bc3e8c99d18e01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.643652:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 0000000081ba2761/0x55bc3e8c99d18e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186372.643660:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b9fc5f8f800 10000000:01000000:3.0:1784186372.643669:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784186372.643673:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b9fc5f8f800 10000000:01000000:3.0:1784186372.643675:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784186372.643678:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9b9fc5f8f800 from 1 10000000:01000000:3.0:1784186372.643681:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784186372.643700:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000f025cd12/0x55bc3e8c99d18e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.643707:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000f025cd12/0x55bc3e8c99d18e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.643714:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000f025cd12/0x55bc3e8c99d18e0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186372.643725:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004c0842c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937903744:0@lo:101: 00000100:00100000:3.0:1784186372.643750:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186372.643782:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dae7c709 going to sleep for 11 seconds 00000100:00100000:3.0:1784186372.643799:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937903744 00000100:00100000:3.0:1784186372.643802:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937903744 00000100:00100000:3.0:1784186372.643819:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784186372.643825:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e95d5c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+6:5763:x1870854937903744:12345-0@lo:101: 00010000:00010000:3.0:1784186372.643898:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186372.643909:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f11636e6/0x55bc3e8c99d18e16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18e0f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.643924:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f11636e6/0x55bc3e8c99d18e16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e0f expref: 7 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.643933:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f11636e6/0x55bc3e8c99d18e16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e0f expref: 7 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.643951:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f11636e6, rc 0) 00000100:00100000:3.0:1784186372.643981:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e95d5c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+7:5763:x1870854937903744:12345-0@lo:101: Request processed in 156us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186372.643987:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784186372.644018:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004c0842c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937903744:0@lo:101: 00010000:00010000:3.0:1784186372.644028:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000f025cd12/0x55bc3e8c99d18e0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.644035:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000f025cd12/0x55bc3e8c99d18e0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186372.644045:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784186372.644048:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000f025cd12/0x55bc3e8c99d18e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.644053:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000f025cd12/0x55bc3e8c99d18e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186372.644058:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784186372.644061:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784186372.644066:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b9fc5f8f800 10000000:01000000:3.0:1784186372.644067:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784186372.644069:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784186372.644071:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784186372.644081:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000e5a2d07f/0x55bc3e8c99d18e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.644087:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000e5a2d07f/0x55bc3e8c99d18e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.644098:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000e5a2d07f/0x55bc3e8c99d18e1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186372.644109:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004c0842c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937903872:0@lo:101: 00000100:00100000:3.0:1784186372.644133:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186372.644146:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dae7c709 going to sleep for 11 seconds 00000100:00100000:3.0:1784186372.644159:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937903872 00000100:00100000:3.0:1784186372.644162:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937903872 00000100:00100000:3.0:1784186372.644178:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186372.644183:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001490668c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+7:5763:x1870854937903872:12345-0@lo:101: 00010000:00010000:3.0:1784186372.644255:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186372.644264:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cd8a6d1a/0x55bc3e8c99d18e24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18e1d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.644276:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cd8a6d1a/0x55bc3e8c99d18e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e1d expref: 8 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.644283:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cd8a6d1a/0x55bc3e8c99d18e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e1d expref: 8 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.644289:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cd8a6d1a, rc 0) 00000100:00100000:3.0:1784186372.644312:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001490668c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+8:5763:x1870854937903872:12345-0@lo:101: Request processed in 130us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186372.644317:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186372.644342:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004c0842c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937903872:0@lo:101: 00010000:00010000:3.0:1784186372.644350:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000e5a2d07f/0x55bc3e8c99d18e1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186372.644364:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000e5a2d07f/0x55bc3e8c99d18e1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186372.644395:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004c0842c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904000:0@lo:501: 00000100:00100000:3.0:1784186372.644415:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186372.644426:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dae7c709 going to sleep for 11 seconds 00000100:00100000:3.0:1784186372.644436:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937904000 00000100:00100000:3.0:1784186372.644461:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937904000 00000100:00100000:3.0:1784186372.644476:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784186372.644480:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3bcc851 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+8:5763:x1870854937904000:12345-0@lo:501: 00000100:00100000:3.0:1784186372.644645:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3bcc851 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+9:5763:x1870854937904000:12345-0@lo:501: Request processed in 163us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186372.644652:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784186372.644677:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004c0842c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904000:0@lo:501: 00000100:00100000:3.0:1784186372.644700:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004c0842c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904128:0@lo:503: 00000100:00100000:3.0:1784186372.644731:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186372.644748:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dae7c709 going to sleep for 11 seconds 00000100:00100000:3.0:1784186372.644771:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937904128 00000100:00100000:3.0:1784186372.644774:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937904128 00000100:00100000:3.0:1784186372.644789:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784186372.644793:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a7ffba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+9:5763:x1870854937904128:12345-0@lo:503: 00000100:00100000:3.0:1784186372.645154:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a7ffba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+9:5763:x1870854937904128:12345-0@lo:503: Request processed in 359us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186372.645161:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784186372.645343:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004c0842c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904128:0@lo:503: 00000100:00100000:2.0:1784186372.645933:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000686189ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:5807:1870854937904256:0@lo:502: 00000100:00100000:2.0:1784186372.645971:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186372.646038:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set 000000005e493876 going to sleep for 11 seconds 00000100:00100000:1.0:1784186372.646074:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937904256 00000100:00100000:1.0:1784186372.646079:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937904256 00000100:00100000:1.0:1784186372.646147:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784186372.646160:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a6e889c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+9:5807:x1870854937904256:12345-0@lo:502: 00000100:00100000:1.0:1784186372.646343:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a6e889c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+9:5807:x1870854937904256:12345-0@lo:502: Request processed in 183us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186372.646350:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784186372.646425:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000686189ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:5807:1870854937904256:0@lo:502: 00000020:01000000:2.0:1784186372.646476:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186372.646485:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186372.646487:0:5807:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784186372.646492:0:5807:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784186372.646495:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784186372.646514:0:5807:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000004db1f3d6) 00000020:00000080:2.0:1784186372.646533:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784186372.646540:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784186372.646609:0:5807:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784186372.646616:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d18e32 00000020:00000080:2.0:1784186372.646850:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784186372.646861:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186372.646864:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186372.646865:0:5807:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784186372.646868:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186372.646871:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186372.646872:0:5807:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784186372.646875:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784186372.646881:0:5807:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ee36e1c2) 00000020:00000080:2.0:1784186372.646890:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784186372.646894:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784186372.646895:0:5807:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784186372.646898:0:5807:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784186372.646904:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784186372.646958:0:5807:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000048f1f68a from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784186372.646971:0:5807:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f6a2c70a) 00000020:00000080:2.0:1784186372.646980:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1784186372.647034:0:5807:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784186372.647040:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x55bc3e8c99d18e47 00000020:00000080:2.0:1784186372.647133:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784186372.647139:0:5807:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784186372.647144:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x55bc3e8c99d18e4e 00080000:01000000:2.0:1784186372.647149:0:5807:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784186372.647151:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d18e55 00080000:10000000:2.0:1784186372.647549:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1784186372.647734:0:5807:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1784186372.654060:0:5807:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1784186372.751666:0:5807:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1784186372.752182:0:5807:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1784186372.758973:0:5807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1784186372.759414:0:5807:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784186372.807399:0:5807:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000008d56a039) 00000020:00000080:3.0:1784186372.807421:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784186372.807517:0:5807:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784186372.807524:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d18e63 00000020:00000080:3.0:1784186372.818514:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1784186372.820233:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784186372.891990:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186372.924570:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186372.992176:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186373.064061:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:3.0:1784186373.118428:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1784186373.145969:0:5807:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1784186373.182649:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x55bc3e8c99d18e6a 00000020:00000080:1.0:1784186373.183251:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784186373.183265:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784186373.183272:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784186373.183274:0:5807:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784186373.183277:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784186373.183284:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784186373.183285:0:5807:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784186373.183289:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784186373.183327:0:5807:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784186373.183343:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784186373.183347:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784186373.183348:0:5807:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784186373.183350:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784186373.183352:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784186373.183354:0:5807:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784186373.183356:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784186373.183358:0:5807:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784186373.183400:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d91e5f9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:5807:1870854937904384:0@lo:502: 00000100:00100000:1.0:1784186373.183508:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186373.183554:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d3600588 going to sleep for 11 seconds 00000100:00100000:2.0:1784186373.183742:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937904384 00000100:00100000:2.0:1784186373.183758:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937904384 00000100:00100000:2.0:1784186373.183808:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784186373.183831:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044066a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+9:5807:x1870854937904384:12345-0@lo:502: 00000100:00100000:2.0:1784186373.184395:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044066a74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+9:5807:x1870854937904384:12345-0@lo:502: Request processed in 564us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186373.184403:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784186373.184659:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d91e5f9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:5807:1870854937904384:0@lo:502: 00000020:01000000:1.0:1784186373.184688:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784186373.184694:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784186373.184695:0:5807:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784186373.184699:0:5807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1784186373.184920:0:5763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1784186373.184941:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784186373.184964:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000e5a2d07f/0x55bc3e8c99d18e1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.184974:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000e5a2d07f/0x55bc3e8c99d18e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186373.184980:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b9fc5f8f800 from 1 10000000:01000000:0.0:1784186373.184983:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784186373.185024:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.185032:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.185040:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186373.185056:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000eab1496 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904512:0@lo:101: 00000100:00100000:0.0:1784186373.185104:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186373.185139:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000763dc52c going to sleep for 11 seconds 00000100:00100000:3.0:1784186373.185255:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937904512 00000100:00100000:3.0:1784186373.185262:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937904512 00000100:00100000:3.0:1784186373.185303:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784186373.185311:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d5e5ed3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+9:5763:x1870854937904512:12345-0@lo:101: 00010000:00010000:3.0:1784186373.185323:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186373.185336:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18e78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18e71 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186373.185355:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18e78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e71 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186373.185365:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18e78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e71 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186373.185374:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6b9a105, rc 0) 00000100:00100000:3.0:1784186373.185406:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d5e5ed3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+10:5763:x1870854937904512:12345-0@lo:101: Request processed in 96us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186373.185420:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784186373.185636:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000eab1496 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904512:0@lo:101: 00010000:00010000:0.0:1784186373.185649:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.185666:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186373.186318:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000eab1496 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904640:0@lo:256: 00000100:00100000:0.0:1784186373.186366:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186373.186403:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000763dc52c going to sleep for 11 seconds 00000100:00100000:2.0:1784186373.186595:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937904640 00000100:00100000:2.0:1784186373.186601:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937904640 00000100:00100000:2.0:1784186373.186674:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784186373.186682:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cf8cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+10:5763:x1870854937904640:12345-0@lo:256: 20000000:01000000:2.0:1784186373.186699:0:5774:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784186373.186706:0:5774:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784186373.186785:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cf8cb00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+10:5763:x1870854937904640:12345-0@lo:256: Request processed in 105us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186373.186792:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784186373.186867:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000eab1496 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904640:0@lo:256: 10000000:01000000:0.0:1784186373.187403:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784186373.187426:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.187435:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186373.187475:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc5f8f800 from 1 10000000:01000000:0.0:1784186373.187478:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784186373.187501:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.187508:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.187516:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186373.187531:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000eab1496 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904768:0@lo:101: 00000100:00100000:0.0:1784186373.187562:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186373.197684:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000763dc52c going to sleep for 11 seconds 00000100:00100000:3.0:1784186373.199509:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937904768 00000100:00100000:3.0:1784186373.199521:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937904768 00000100:00100000:3.0:1784186373.199583:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784186373.199591:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036e26876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+10:5763:x1870854937904768:12345-0@lo:101: 00010000:00010000:3.0:1784186373.199610:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186373.199627:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000031dad428/0x55bc3e8c99d18e86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18e7f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186373.199655:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000031dad428/0x55bc3e8c99d18e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e7f expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186373.199665:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000031dad428/0x55bc3e8c99d18e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e7f expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186373.199674:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000031dad428, rc 0) 00000100:00100000:3.0:1784186373.204287:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036e26876 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+11:5763:x1870854937904768:12345-0@lo:101: Request processed in 4684us (16712us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186373.204302:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784186373.208066:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000eab1496 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904768:0@lo:101: 00010000:00010000:0.0:1784186373.208111:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.208124:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186373.208240:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000eab1496 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904896:0@lo:501: 00000100:00100000:0.0:1784186373.208300:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186373.208427:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937904896 00000100:00100000:3.0:1784186373.208433:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937904896 00000100:00100000:0.0:1784186373.208494:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000763dc52c going to sleep for 11 seconds 00000100:00100000:2.0:1784186373.213011:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784186373.213033:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe5677a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+11:5763:x1870854937904896:12345-0@lo:501: 00000100:00100000:2.0:1784186373.213775:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe5677a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+11:5763:x1870854937904896:12345-0@lo:501: Request processed in 751us (5473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186373.213786:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784186373.215968:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000eab1496 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937904896:0@lo:501: 00000100:00100000:1.0:1784186373.216114:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d91e5f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937905024:0@lo:503: 00000100:00100000:1.0:1784186373.216190:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186373.216243:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d3600588 going to sleep for 11 seconds 00000100:00100000:0.0:1784186373.216348:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937905024 00000100:00100000:0.0:1784186373.216354:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937905024 00000100:00100000:0.0:1784186373.216403:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784186373.216410:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008eea1752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+11:5763:x1870854937905024:12345-0@lo:503: 00000040:00080000:0.0:1784186373.216486:0:5775:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784186373.216537:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008eea1752 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+11:5763:x1870854937905024:12345-0@lo:503: Request processed in 127us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186373.216545:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784186373.216687:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d91e5f9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937905024:0@lo:503: 00000040:00080000:1.0:1784186373.217601:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1784186373.217814:0:5763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1784186373.217844:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784186373.217861:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.217873:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186373.217930:0:5763:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784186373.217933:0:5763:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b9fc5f8f800 10000000:01000000:0.0:1784186373.217936:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b9fc5f8f800 10000000:01000000:0.0:1784186373.217941:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784186373.217946:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9fc5f8f800 from 1 10000000:01000000:0.0:1784186373.217949:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784186373.217975:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 0000000001c2e26f/0x55bc3e8c99d18e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.217982:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 0000000001c2e26f/0x55bc3e8c99d18e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.217991:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 0000000001c2e26f/0x55bc3e8c99d18e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186373.218009:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e6427668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937905152:0@lo:101: 00000100:00100000:0.0:1784186373.218054:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186373.218084:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 000000009b514f2d going to sleep for 11 seconds 00000100:00100000:2.0:1784186373.218254:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937905152 00000100:00100000:2.0:1784186373.218260:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937905152 00000100:00100000:2.0:1784186373.218298:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784186373.218305:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6530403 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+11:5763:x1870854937905152:12345-0@lo:101: 00010000:00010000:2.0:1784186373.218318:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186373.218331:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000001fd75ac/0x55bc3e8c99d18e94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18e8d expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186373.218353:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000001fd75ac/0x55bc3e8c99d18e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e8d expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186373.218369:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000001fd75ac/0x55bc3e8c99d18e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e8d expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186373.218378:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000001fd75ac, rc 0) 00000100:00100000:2.0:1784186373.218424:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6530403 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5763:x1870854937905152:12345-0@lo:101: Request processed in 119us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186373.218429:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784186373.218575:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e6427668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937905152:0@lo:101: 00010000:00010000:3.0:1784186373.218590:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 0000000001c2e26f/0x55bc3e8c99d18e8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186373.218598:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 0000000001c2e26f/0x55bc3e8c99d18e8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186373.218645:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a2226b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937905280:0@lo:501: 00000100:00100000:3.0:1784186373.218677:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186373.218712:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f25277b6 going to sleep for 11 seconds 00000100:00100000:2.0:1784186373.218914:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937905280 00000100:00100000:2.0:1784186373.218919:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937905280 00000100:00100000:2.0:1784186373.218949:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784186373.218955:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1941c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5763:x1870854937905280:12345-0@lo:501: 00000100:00100000:2.0:1784186373.219204:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1941c38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5763:x1870854937905280:12345-0@lo:501: Request processed in 248us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186373.219210:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784186373.219236:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a2226b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937905280:0@lo:501: 00000100:00100000:3.0:1784186373.219272:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a2226b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937905408:0@lo:503: 00000100:00100000:3.0:1784186373.219309:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186373.219329:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f25277b6 going to sleep for 11 seconds 00000100:00100000:0.0:1784186373.219490:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937905408 00000100:00100000:0.0:1784186373.219494:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937905408 00000100:00100000:0.0:1784186373.219521:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784186373.219527:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfe8440d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5763:x1870854937905408:12345-0@lo:503: 00000100:00100000:0.0:1784186373.219895:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfe8440d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5763:x1870854937905408:12345-0@lo:503: Request processed in 367us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186373.219903:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784186373.220480:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a2226b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937905408:0@lo:503: 00000100:00100000:1.0:1784186373.225565:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d91e5f9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:5812:1870854937905536:0@lo:502: 00000100:00100000:1.0:1784186373.225652:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186373.225755:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 000000007c3642e1 going to sleep for 11 seconds 00000100:00100000:0.0:1784186373.227339:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937905536 00000100:00100000:0.0:1784186373.227350:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937905536 00000100:00100000:0.0:1784186373.227408:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784186373.227427:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d4db646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5812:x1870854937905536:12345-0@lo:502: 00000100:00100000:0.0:1784186373.227757:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d4db646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5812:x1870854937905536:12345-0@lo:502: Request processed in 331us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186373.227765:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784186373.227935:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d91e5f9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:5812:1870854937905536:0@lo:502: 00000020:01000004:1.0:1784186373.227997:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784186373.228020:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000f65c66a1) 00000020:00000080:1.0:1784186373.228038:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1784186373.228332:0:5812:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000048f1f68a from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784186373.228336:0:5812:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000048f1f68a from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784186373.228338:0:5812:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000048f1f68a 4 00010000:00080000:1.0:1784186373.228363:0:5812:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c6c74fc5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:1.0:1784186373.230838:0:5812:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1784186373.230959:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784186373.230996:0:5812:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784186373.231012:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x55bc3e8c99d18ea2 00000100:00080000:1.0:1784186373.231024:0:5812:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784186373.231029:0:5812:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c6c74fc5 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1784186373.231063:0:5812:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006d91e5f9 x1870854937905664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784186373.231082:0:5812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784186373.231298:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006d91e5f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870854937905664:0@lo:38: 00000100:00100000:0.0:1784186373.231370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186373.231778:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937905664 00000100:00100000:1.0:1784186373.231785:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937905664 00000100:00100000:1.0:1784186373.231914:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784186373.231930:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a4f1a4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1870854937905664:12345-0@lo:38: 00000100:00100000:1.0:1784186373.231990:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a4f1a4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1870854937905664:12345-0@lo:38: Request processed in 60us (620us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784186373.231998:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784186373.233853:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784186373.233867:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000c6c74fc5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784186373.233874:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784186373.233877:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006d91e5f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870854937905664:0@lo:38: 00000100:00100000:2.0:1784186373.241419:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000686189ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:5812:1870854937905792:0@lo:502: 00000100:00100000:2.0:1784186373.241528:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186373.241575:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 0000000091d8b425 going to sleep for 11 seconds 00000100:00100000:0.0:1784186373.242213:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937905792 00000100:00100000:0.0:1784186373.242223:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937905792 00000100:00100000:0.0:1784186373.242283:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784186373.242294:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006938d7c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5812:x1870854937905792:12345-0@lo:502: 00000100:00100000:0.0:1784186373.242608:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006938d7c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5812:x1870854937905792:12345-0@lo:502: Request processed in 316us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186373.242617:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784186373.243357:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000686189ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:5812:1870854937905792:0@lo:502: 00000040:00080000:3.0:1784186373.243390:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1784186373.244058:0:5763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1784186373.244079:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784186373.244094:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 0000000001c2e26f/0x55bc3e8c99d18e8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186373.244114:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 0000000001c2e26f/0x55bc3e8c99d18e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784186373.244165:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784186373.244167:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784186373.244173:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186373.244174:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186373.244175:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186373.244176:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186373.244177:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784186373.244178:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784186373.244179:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784186373.244181:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784186373.244182:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186373.244183:0:5763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784186373.244187:0:5763:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1784186373.244189:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784186373.244190:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784186373.244191:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186373.244192:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186373.244193:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186373.244193:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186373.244194:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784186373.244195:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784186373.244196:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784186373.244196:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784186373.244197:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186373.244198:0:5763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784186373.244216:0:5763:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784186373.244232:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003fcc673a pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937905920:0@lo:253: 00000100:00100000:2.0:1784186373.244286:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186373.244318:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 0000000091d8b425 going to sleep for 11 seconds 00000100:00100000:0.0:1784186373.244561:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937905920 00000100:00100000:0.0:1784186373.244569:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937905920 00000100:00100000:0.0:1784186373.244611:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784186373.244618:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3544720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5763:x1870854937905920:12345-0@lo:253: 20000000:01000000:0.0:1784186373.244642:0:5775:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784186373.244654:0:5775:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784186373.328727:0:5775:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784186373.328759:0:5775:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784186373.329500:0:5798:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784186373.329507:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784186373.329527:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186373.329547:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18e78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e71 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186373.329554:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186373.329833:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18e78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18e71 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186373.329868:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18e78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e71 expref: 12 pid: 5777 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186373.329881:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004a2226b9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5798:1870854937906048:0@lo:104: 00000100:00100000:3.0:1784186373.329950:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186373.330013:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set 000000004adf67f7 going to sleep for 11 seconds 00000100:00100000:1.0:1784186373.330152:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937906048 00000100:00100000:1.0:1784186373.330160:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937906048 00000100:00100000:1.0:1784186373.330206:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784186373.330214:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000372030be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+3:5798:x1870854937906048:12345-0@lo:104: 00010000:00010000:1.0:1784186373.330226:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.330289:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784186373.330295:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000372030be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+3:5798:x1870854937906048:12345-0@lo:104: Request processed in 82us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186373.330302:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1784186373.330325:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186373.330330:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.330337:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d5099e10 already unused, calling callback (0000000036c3255e) 10000000:00010000:1.0:1784186373.330355:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.330362:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784186373.330368:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186373.330373:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784186373.330404:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.330412:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784186373.330428:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.330434:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: 00000000d5099e10/0x55bc3e8c99d18e71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e78 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.330466:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186373.330468:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186373.330469:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186373.330630:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004a2226b9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5798:1870854937906048:0@lo:104: 00010000:00010000:0.0:1784186373.330648:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186373.332037:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000003c1ad75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937906176:0@lo:103: 00000100:00100000:3.0:1784186373.332088:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186373.332182:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937906176 00000100:00100000:1.0:1784186373.332189:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937906176 00010000:00010000:1.0:1784186373.332215:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18e78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e71 expref: 13 pid: 5777 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186373.332251:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784186373.332258:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000000d3885 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:3307:x1870854937906176:12345-0@lo:103: 00010000:00010000:1.0:1784186373.332271:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186373.332275:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18e78 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e71 expref: 13 pid: 5777 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.332286:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18e78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e71 expref: 13 pid: 5777 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.332301:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18e78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18e71 expref: 13 pid: 5777 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.332316:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.332336:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784186373.332350:0:5767:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002844353s 00010000:00010000:1.0:1784186373.332354:0:5767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.332360:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.332365:0:5767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.332371:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.332377:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006440ec36 already unused, calling callback (000000000e3bc0e5) 00010000:00010000:1.0:1784186373.332381:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.332387:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.332407:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186373.332416:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186373.332469:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000000d3885 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3307:x1870854937906176:12345-0@lo:103: Request processed in 212us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186373.332476:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784186373.332562:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000003c1ad75 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937906176:0@lo:103: 00010000:00010000:0.0:1784186373.332797:0:5798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.332805:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186373.332887:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006440ec36/0x55bc3e8c99d18ea9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186373.347848:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3544720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+11:5763:x1870854937905920:12345-0@lo:253: Request processed in 103220us (103552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186373.347866:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784186373.348011:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003fcc673a pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:5763:1870854937905920:0@lo:253: 10000000:01000000:2.0:1784186373.348028:0:5763:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784186373.348032:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784186373.348034:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784186373.348036:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186373.348037:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186373.348039:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186373.348040:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186373.348041:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784186373.348055:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784186373.348057:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784186373.348059:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784186373.348060:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186373.348062:0:5763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784186373.348076:0:5763:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784186373.355941:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186373.356320:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784186373.357239:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186373.357483:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784186373.357725:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186373.357988:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1784186373.359147:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186373.359400:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1784186373.359965:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186373.360144:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1784186373.360428:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186373.360790:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1784186373.462928:0:5763:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1784186373.504880:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1784186373.505240:0:5818:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1784186373.509781:0:5817:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1784186373.509788:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1784186373.516341:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784186373.516701:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784186373.517288:0:5763:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784186373.517296:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784186373.517432:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784186373.518532:0:5763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784186373.520068:0:5763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784186373.520408:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1784186373.520701:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784186373.521347:0:5763:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1784186373.523121:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1784186373.523368:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1784186373.523847:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1784186373.523990:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1784186373.524123:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1784186373.524513:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1784186373.524674:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1784186373.524947:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1784186373.525097:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1784186373.525317:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1784186373.526392:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1784186373.526591:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1784186373.526747:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1784186373.526909:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1784186373.527057:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1784186373.529606:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1784186373.530271:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1784186373.530431:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1784186373.530761:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1784186373.531199:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1784186373.531367:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1784186373.531537:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1784186373.531683:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1784186373.532015:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1784186373.532164:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1784186373.532815:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1784186373.533057:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1784186373.533192:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1784186373.533336:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1784186373.533586:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1784186373.533726:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1784186373.534032:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1784186373.536197:0:5763:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1784186373.555613:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1784186373.599201:0:5763:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784186373.599237:0:5763:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab9e816e7988 00100000:10000000:1.0:1784186373.599245:0:5763:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1784186373.600655:0:5763:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784186373.600673:0:5763:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784186373.600687:0:5763:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784186373.600716:0:5763:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1784186373.634018:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784186373.634104:0:5818:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784186373.634109:0:5818:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1784186374.142551:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186375.167148:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186376.191382:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186377.217912:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186378.253680:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186378.433794:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000056909bba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937906304:0@lo:400: 00000100:00100000:3.0:1784186378.433867:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784186378.433999:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784186378.434004:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784186378.434006:0:38:0:(import.c:65:import_set_state_nolock()) 00000000c6c74fc5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784186378.434016:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c6c74fc5 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1784186378.434037:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f567e485 x1870854937906432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784186378.434170:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f567e485 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870854937906432:0@lo:38: 00000100:00100000:2.0:1784186378.434207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186378.434925:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937906304 00000100:00100000:0.0:1784186378.434938:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937906304 00000100:00100000:0.0:1784186378.434981:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784186378.434988:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eda0295e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+11:3308:x1870854937906304:12345-0@lo:400: 00000100:00100000:1.0:1784186378.435090:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937906432 00000100:00100000:1.0:1784186378.435095:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937906432 00000100:00100000:1.0:1784186378.435117:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784186378.435122:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fcc673a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1870854937906432:12345-0@lo:38: 00010000:00080000:1.0:1784186378.435142:0:5784:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:1.0:1784186378.435180:0:5784:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x55bc3e8c99d18eb0 00000004:00100000:1.0:1784186378.435218:0:5784:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784186378.435324:0:5784:0:(import.c:65:import_set_state_nolock()) 0000000071d06404 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784186378.435373:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fcc673a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870854937906432:12345-0@lo:38: Request processed in 251us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186378.435388:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784186378.435462:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f567e485 x1870854937906432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784186388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784186378.435477:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784186378.435484:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784186378.435489:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784186378.435491:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000c6c74fc5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784186378.435496:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f567e485 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870854937906432:0@lo:38: 00000100:00100000:0.0:1784186378.445169:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eda0295e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+11:3308:x1870854937906304:12345-0@lo:400: Request processed in 10170us (11292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186378.445187:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784186378.447574:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000056909bba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937906304:0@lo:400: 00000001:02000400:2.0:1784186378.594810:0:6061:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1784186378.961865:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784186378.961881:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b9fc5f8f800 from 3 10000000:01000000:2.0:1784186378.961887:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784186378.961928:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 00000000ef31e2f2/0x55bc3e8c99d18eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186378.961939:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 00000000ef31e2f2/0x55bc3e8c99d18eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186378.961949:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 00000000ef31e2f2/0x55bc3e8c99d18eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186378.961972:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b6b5dcff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937906560:0@lo:101: 00000100:00100000:2.0:1784186378.962033:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186378.962114:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set 0000000091d8b425 going to sleep for 11 seconds 00000100:00100000:3.0:1784186378.962158:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937906560 00000100:00100000:3.0:1784186378.962166:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937906560 00000100:00100000:3.0:1784186378.962242:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784186378.962250:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee358171 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+11:5780:x1870854937906560:12345-0@lo:101: 00010000:00010000:3.0:1784186378.962262:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186378.962273:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049d57bd2/0x55bc3e8c99d18ebe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18eb7 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186378.962293:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049d57bd2/0x55bc3e8c99d18ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18eb7 expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186378.962302:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049d57bd2/0x55bc3e8c99d18ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18eb7 expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186378.962310:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049d57bd2, rc 0) 00000100:00100000:3.0:1784186378.962384:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee358171 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5780:x1870854937906560:12345-0@lo:101: Request processed in 136us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186378.962391:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784186378.962629:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b6b5dcff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937906560:0@lo:101: 00010000:00010000:2.0:1784186378.962642:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 00000000ef31e2f2/0x55bc3e8c99d18eb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186378.962662:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 00000000ef31e2f2/0x55bc3e8c99d18eb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186378.962709:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b6b5dcff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937906688:0@lo:256: 00000100:00100000:2.0:1784186378.962810:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186378.962880:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set 0000000091d8b425 going to sleep for 11 seconds 00000100:00100000:3.0:1784186378.962945:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937906688 00000100:00100000:3.0:1784186378.962950:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937906688 00000100:00100000:3.0:1784186378.962982:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784186378.962988:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f065891a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5780:x1870854937906688:12345-0@lo:256: 20000000:01000000:3.0:1784186378.963002:0:5775:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784186378.963020:0:5775:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784186378.963023:0:5775:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1784186378.963191:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f065891a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5780:x1870854937906688:12345-0@lo:256: Request processed in 203us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186378.963198:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784186378.963266:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b6b5dcff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937906688:0@lo:256: 10000000:01000000:2.0:1784186378.963303:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784186378.963309:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: 00000000ef31e2f2/0x55bc3e8c99d18eb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186378.963324:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: 00000000ef31e2f2/0x55bc3e8c99d18eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186379.265850:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186380.302540:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186381.315484:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186382.352086:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186383.370307:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186383.549814:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784186383.549842:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f567e485 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937906816:0@lo:400: 00000100:00100000:3.0:1784186383.549922:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186383.549985:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937906816 00000100:00100000:3.0:1784186383.549993:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937906816 00000100:00100000:3.0:1784186383.550038:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784186383.550046:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097ad4bca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3308:x1870854937906816:12345-0@lo:400: 00000100:00100000:3.0:1784186383.550097:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097ad4bca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3308:x1870854937906816:12345-0@lo:400: Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186383.550105:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784186383.550151:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f567e485 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937906816:0@lo:400: 00000100:00100000:1.0:1784186383.550560:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784186383.550571:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e729850e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937906944:0@lo:400: 00000100:00100000:1.0:1784186383.550617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186383.550649:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937906944 00000100:00100000:1.0:1784186383.550784:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937906944 00000100:00100000:1.0:1784186383.550819:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784186383.550825:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7a07d67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937906944:12345-0@lo:400: 00000100:00100000:1.0:1784186383.550866:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7a07d67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937906944:12345-0@lo:400: Request processed in 41us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186383.550873:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784186383.550908:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e729850e x1870854937906944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186383.550919:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e729850e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937906944:0@lo:400: 00000020:00000080:2.0:1784186383.845129:0:6263:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4c31a290 20000000:00000080:2.0:1784186383.845147:0:6263:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b9fefe1ec00 uarg=0000000000000000 20000000:01000000:2.0:1784186383.845179:0:6263:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1784186383.845185:0:6263:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1784186383.845190:0:6263:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1784186383.846155:0:6263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1784186383.846169:0:6263:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1784186383.852166:0:6263:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784186383.852739:0:6263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784186383.852789:0:6263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1784186383.852820:0:6263:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1784186383.852836:0:6263:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784186383.852853:0:6263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186383.852873:0:6263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000031dad428/0x55bc3e8c99d18e86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e7f expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186383.852881:0:6263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186383.853004:0:6263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000031dad428/0x55bc3e8c99d18e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18e7f expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186383.853018:0:6263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000031dad428/0x55bc3e8c99d18e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e7f expref: 11 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186383.853029:0:6263:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006fae8ce1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6263:1870854937907072:0@lo:104: 00000100:00100000:3.0:1784186383.853097:0:6263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186383.853201:0:6263:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c567f1fc going to sleep for 11 seconds 00000100:00100000:1.0:1784186383.853253:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937907072 00000100:00100000:1.0:1784186383.853265:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937907072 00000100:00100000:1.0:1784186383.853331:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784186383.853338:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e49e1f91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:6263:x1870854937907072:12345-0@lo:104: 00010000:00010000:1.0:1784186383.853348:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186383.853554:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784186383.853559:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e49e1f91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:6263:x1870854937907072:12345-0@lo:104: Request processed in 222us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186383.853576:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1784186383.853672:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186383.853677:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853685:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007440babe already unused, calling callback (0000000036c3255e) 10000000:00010000:2.0:1784186383.853688:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853694:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186383.853701:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186383.853707:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784186383.853739:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853745:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784186383.853766:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853770:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: 000000007440babe/0x55bc3e8c99d18e7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e86 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853785:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186383.853786:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186383.853787:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186383.853796:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b6b5dcff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937907200:0@lo:103: 00000100:00100000:2.0:1784186383.853820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186383.853854:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937907200 00000100:00100000:2.0:1784186383.853858:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937907200 00010000:00010000:2.0:1784186383.853874:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000031dad428/0x55bc3e8c99d18e86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e7f expref: 12 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186383.853896:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784186383.853901:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ae650d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3307:x1870854937907200:12345-0@lo:103: 00010000:00010000:2.0:1784186383.853925:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186383.853930:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000031dad428/0x55bc3e8c99d18e86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e7f expref: 12 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853938:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000031dad428/0x55bc3e8c99d18e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e7f expref: 12 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853951:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853956:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853973:0:5767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853977:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853981:0:5767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853984:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853987:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e6b9a105 already unused, calling callback (000000000e3bc0e5) 00010000:00010000:2.0:1784186383.853989:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853992:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.853996:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186383.854002:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186383.854022:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ae650d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3307:x1870854937907200:12345-0@lo:103: Request processed in 122us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186383.854026:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784186383.854056:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b6b5dcff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937907200:0@lo:103: 00010000:00010000:0.0:1784186383.854243:0:6263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000031dad428/0x55bc3e8c99d18e86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18e7f expref: 11 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186383.854253:0:6263:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006fae8ce1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6263:1870854937907072:0@lo:104: 00010000:00010000:0.0:1784186383.854266:0:6263:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186383.854272:0:6263:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186383.854276:0:6263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186383.854279:0:6263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e6b9a105/0x55bc3e8c99d18ec5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186384.386821:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186385.405974:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186386.437896:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784186387.454978:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784186387.454986:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc5f8f800 from 1 10000000:01000000:3.0:1784186387.454992:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784186387.455036:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: 000000006440ec36/0x55bc3e8c99d18ecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186387.455048:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: 000000006440ec36/0x55bc3e8c99d18ecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186387.455058:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: 000000006440ec36/0x55bc3e8c99d18ecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186387.455080:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000015c4e019 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937907328:0@lo:101: 00000100:00100000:3.0:1784186387.455155:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186387.455220:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e6a2a4df going to sleep for 11 seconds 00010000:00010000:3.0:1784186387.455383:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186387.455467:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937907328 00000100:00100000:2.0:1784186387.455593:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937907328 00000100:00100000:2.0:1784186387.455683:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784186387.455694:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097955f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+11:5780:x1870854937907328:12345-0@lo:101: 00010000:00010000:2.0:1784186387.455710:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186387.455723:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000598132d0/0x55bc3e8c99d18ed3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18ecc expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186387.455747:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000598132d0/0x55bc3e8c99d18ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18ecc expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186387.455757:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000598132d0/0x55bc3e8c99d18ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18ecc expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186387.455765:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000598132d0, rc 0) 00000100:00100000:2.0:1784186387.455834:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097955f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5780:x1870854937907328:12345-0@lo:101: Request processed in 143us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186387.455841:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784186387.457161:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000015c4e019 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937907328:0@lo:101: 00010000:00010000:0.0:1784186387.457185:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: 000000006440ec36/0x55bc3e8c99d18ecc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186387.457195:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: 000000006440ec36/0x55bc3e8c99d18ecc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186387.457266:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001d5eb9ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937907456:0@lo:501: 00000100:00100000:0.0:1784186387.457311:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186387.472608:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c91f1f0b going to sleep for 11 seconds 00000100:00100000:3.0:1784186387.474821:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937907456 00000100:00100000:3.0:1784186387.474836:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937907456 00000100:00100000:3.0:1784186387.474952:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784186387.474960:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e61a46b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5780:x1870854937907456:12345-0@lo:501: 00000100:00100000:3.0:1784186387.475281:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e61a46b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5780:x1870854937907456:12345-0@lo:501: Request processed in 322us (17970us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186387.475289:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784186387.475331:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001d5eb9ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937907456:0@lo:501: 00000100:00100000:3.0:1784186387.475375:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000604733db pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937907584:0@lo:503: 00000100:00100000:3.0:1784186387.475421:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186387.475470:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045ea3013 going to sleep for 11 seconds 00000100:00100000:3.0:1784186387.475519:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937907584 00000100:00100000:3.0:1784186387.475523:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937907584 00000100:00100000:3.0:1784186387.475544:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784186387.475548:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d83bbeb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5780:x1870854937907584:12345-0@lo:503: 00000100:00100000:3.0:1784186387.477151:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d83bbeb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5780:x1870854937907584:12345-0@lo:503: Request processed in 1595us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186387.477163:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784186387.477320:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000604733db pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937907584:0@lo:503: 00000100:00100000:0.0:1784186387.485014:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000318c3e14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6498:1870854937907712:0@lo:502: 00000100:00100000:0.0:1784186387.485102:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186387.485153:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000084cc60f0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186387.485255:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937907712 00000100:00100000:3.0:1784186387.485270:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937907712 00000100:00100000:3.0:1784186387.485318:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784186387.485327:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b10f401a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6498:x1870854937907712:12345-0@lo:502: 00000100:00100000:3.0:1784186387.485642:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b10f401a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6498:x1870854937907712:12345-0@lo:502: Request processed in 316us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186387.485650:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784186387.485808:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000318c3e14 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6498:1870854937907712:0@lo:502: 00000020:01000000:2.0:1784186387.485849:0:6498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186387.485858:0:6498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186387.485860:0:6498:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784186387.485867:0:6498:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9fc5f8f800 00000020:00000080:2.0:1784186387.485870:0:6498:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784186387.485902:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6498:1870854937907840:0@lo:502: 00000100:00100000:2.0:1784186387.485929:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186387.485952:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186387.486052:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937907840 00000100:00100000:1.0:1784186387.486058:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937907840 00000100:00100000:1.0:1784186387.486135:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784186387.486143:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6498:x1870854937907840:12345-0@lo:502: 00000100:00100000:1.0:1784186387.486295:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6498:x1870854937907840:12345-0@lo:502: Request processed in 153us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186387.486302:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784186387.486377:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6498:1870854937907840:0@lo:502: 00000020:01000000:2.0:1784186387.486402:0:6498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186387.486411:0:6498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186387.486412:0:6498:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784186387.486416:0:6498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1784186387.486643:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784186387.486663:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784186387.486674:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fca861a00/0x55bc3e8c99d18ecc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186387.486748:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fca861a00/0x55bc3e8c99d18ecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186388.479257:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186388.669961:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937907968:0@lo:400: 00000100:00100000:3.0:1784186388.670047:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186388.670197:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937907968 00000100:00100000:1.0:1784186388.670206:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937907968 00000100:00100000:1.0:1784186388.670268:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784186388.670278:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3308:x1870854937907968:12345-0@lo:400: 00000100:00100000:2.0:1784186388.670364:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937908096:0@lo:400: 00000100:00100000:2.0:1784186388.670395:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186388.671509:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937908096 00000100:00100000:2.0:1784186388.671517:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937908096 00000100:00100000:2.0:1784186388.671561:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784186388.671577:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937908096:12345-0@lo:400: 00000100:00100000:2.0:1784186388.671637:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937908096:12345-0@lo:400: Request processed in 61us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186388.671645:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784186388.671688:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b9ffd9de300 x1870854937908096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186388.671704:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937908096:0@lo:400: 00000100:00100000:1.0:1784186388.672269:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3308:x1870854937907968:12345-0@lo:400: Request processed in 1990us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186388.672279:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784186388.672412:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937907968:0@lo:400: 00000020:01000004:2.0:1784186389.406733:0:6579:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784186389.406737:0:6579:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1784186389.406893:0:6579:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b9ffef01800 00000020:01000004:2.0:1784186389.406909:0:6579:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1784186389.406921:0:6579:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1784186389.406934:0:6579:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b9ffeefcd40) 00000020:00000080:2.0:1784186389.406949:0:6579:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784186389.430387:0:6579:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1784186389.430721:0:6579:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1784186389.449909:0:6579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1784186389.455251:0:6579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1784186389.455291:0:6579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1784186389.455343:0:6579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1784186389.455364:0:6579:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1784186389.456094:0:6579:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1784186389.456105:0:6579:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784186389.456117:0:6579:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x55bc3e8c99d18ee1 00000020:01000004:1.0:1784186389.456126:0:6579:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1784186389.456148:0:6579:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784186389.456152:0:6579:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784186389.456158:0:6579:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1784186389.456163:0:6579:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1784186389.456175:0:6579:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b9fc92e0000) 00000020:00000080:1.0:1784186389.456186:0:6579:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1784186389.457797:0:6579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784186389.458657:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1784186389.458666:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1784186389.460799:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1784186389.460812:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1784186389.466364:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1784186389.466382:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1784186389.468520:0:6579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784186389.469047:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1784186389.469056:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784186389.470350:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784186389.470359:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784186389.495844:0:6579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784186389.496094:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784186389.496101:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784186389.497787:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784186389.497800:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1784186389.499711:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784186389.499725:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1784186389.502026:0:6579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784186389.502216:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1784186389.502222:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1784186389.503245:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1784186389.503254:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:2.0:1784186389.503731:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186389.576857:0:6579:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784186389.577173:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1784186389.577180:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1784186389.578282:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1784186389.578292:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1784186389.579170:0:6579:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1784186389.579194:0:6579:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1784186389.579201:0:6579:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1784186389.621756:0:6579:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784186389.621798:0:6579:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.131@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1784186389.621802:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784186389.621804:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784186389.621806:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784186389.621807:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784186389.621808:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784186389.621809:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784186389.621811:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784186389.621812:0:6579:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784186389.621814:0:6579:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784186389.621815:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784186389.621816:0:6579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784186389.621819:0:6579:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1784186389.621822:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784186389.621823:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784186389.621824:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784186389.621826:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784186389.621827:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784186389.621828:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784186389.621828:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784186389.621830:0:6579:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784186389.621830:0:6579:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784186389.621832:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784186389.621833:0:6579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784186389.621858:0:6579:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784186389.621877:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937908224:0@lo:253: 00000100:00100000:3.0:1784186389.622042:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.622151:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc76969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186389.622238:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937908224 00000100:00100000:1.0:1784186389.622245:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937908224 00000100:00100000:1.0:1784186389.622629:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784186389.622643:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937908224:12345-0@lo:253: 20000000:01000000:1.0:1784186389.622689:0:5774:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784186389.622693:0:5774:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1784186389.622698:0:5774:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1784186389.622701:0:5774:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1784186389.624282:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784186389.624535:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1784186389.624551:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1784186389.624603:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1784186389.624613:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1784186389.624645:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1784186389.624695:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1784186389.625069:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1784186389.625091:0:5774:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.131@tcp 20000000:01000000:1.0:1784186389.625093:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:1.0:1784186389.625126:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1784186389.625135:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784186389.625177:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1784186389.625185:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:1.0:1784186389.625215:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1784186389.625225:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1784186389.625261:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1784186389.625308:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1784186389.629908:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1784186389.629948:0:5774:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.131@tcp 20000000:01000000:0.0:1784186389.629951:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:0.0:1784186389.629996:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1784186389.630007:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1784186389.630036:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1784186389.630169:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:0.0:1784186389.630248:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1784186389.630261:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1784186389.630324:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1784186389.630368:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1784186389.630388:0:5774:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1784186389.630391:0:5774:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1784186389.630395:0:5774:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1784186389.630408:0:5774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784186389.630411:0:5774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784186389.630497:0:5774:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784186389.630500:0:5774:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784186389.631567:0:6594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1784186389.631632:0:6594:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1784186389.631682:0:6594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1784186389.632380:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1784186389.632425:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1784186389.636308:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1784186389.636363:0:5774:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784186389.636366:0:5774:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784186389.637318:0:6595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1784186389.637385:0:6595:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1784186389.637718:0:6595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1784186389.637952:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1784186389.637997:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1784186389.638186:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1784186389.638200:0:5774:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784186389.638203:0:5774:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784186389.638983:0:6596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1784186389.639762:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1784186389.639807:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1784186389.639875:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1784186389.639892:0:5774:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1784186389.639903:0:5774:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1784186389.639912:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784186389.639934:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.639952:0:5774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc27ed200/0x55bc3e8c99d18e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e01 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.639959:0:5774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fca860000/0x55bc3e8c99d18e24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e1d expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.639965:0:5774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda504a00/0x55bc3e8c99d18e94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18e8d expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.639972:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.640013:0:5774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda504a00/0x55bc3e8c99d18e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18e8d expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.640029:0:5774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fda504a00/0x55bc3e8c99d18e94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e8d expref: 12 pid: 5777 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.640130:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937908352:0@lo:104: 00000100:00100000:3.0:1784186389.640195:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784186389.640262:0:5774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fca860000/0x55bc3e8c99d18e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18e1d expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.640271:0:5774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fca860000/0x55bc3e8c99d18e24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e1d expref: 12 pid: 5775 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.640280:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937908480:0@lo:104: 00000100:00100000:3.0:1784186389.640309:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784186389.640337:0:5774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc27ed200/0x55bc3e8c99d18e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18e01 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.640346:0:5774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fc27ed200/0x55bc3e8c99d18e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e01 expref: 12 pid: 5777 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.640354:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937908608:0@lo:104: 00000100:00100000:3.0:1784186389.640374:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.640383:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcce7c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186389.640423:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937908352 00000100:00100000:2.0:1784186389.640429:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937908352 00000100:00100000:2.0:1784186389.640557:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937908480 00000100:00100000:2.0:1784186389.640561:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937908480 00000100:00100000:2.0:1784186389.640572:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937908608 00000100:00100000:2.0:1784186389.640574:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937908608 00000100:00100000:2.0:1784186389.640586:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784186389.640595:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+5:5774:x1870854937908352:12345-0@lo:104: 00010000:00010000:2.0:1784186389.640607:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc0031000/0x55bc3e8c99d18e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.640703:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784186389.640710:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+5:5774:x1870854937908352:12345-0@lo:104: Request processed in 116us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.640717:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784186389.640735:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784186389.640741:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+4:5774:x1870854937908480:12345-0@lo:104: 00010000:00010000:2.0:1784186389.640748:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fca860e00/0x55bc3e8c99d18e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.640801:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784186389.640809:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc0031000/0x55bc3e8c99d18e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.640823:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031000 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:1.0:1784186389.640827:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc0031000/0x55bc3e8c99d18e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.640836:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc0031000/0x55bc3e8c99d18e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784186389.640843:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc0031000/0x55bc3e8c99d18e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186389.640848:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1784186389.640859:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937908352:0@lo:104: 00000100:00100000:3.0:1784186389.640869:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937908480:0@lo:104: 00010000:00010000:1.0:1784186389.640884:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc0031000/0x55bc3e8c99d18e8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.640891:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784186389.640913:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc0031000/0x55bc3e8c99d18e8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.640918:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937908736:0@lo:103: 00010000:00010000:1.0:1784186389.640920:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc0031000/0x55bc3e8c99d18e8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e94 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.640935:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186389.640939:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fca860e00/0x55bc3e8c99d18e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.640944:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fca860e00 already unused, calling callback (ffffffffc1d84c20) 00000100:00100000:3.0:1784186389.640945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1784186389.640947:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fca860e00/0x55bc3e8c99d18e1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.640964:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fca860e00/0x55bc3e8c99d18e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784186389.640970:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fca860e00/0x55bc3e8c99d18e1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186389.640975:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784186389.640988:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fca860e00/0x55bc3e8c99d18e1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.640994:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784186389.641005:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fca860e00/0x55bc3e8c99d18e1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.641011:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fca860e00/0x55bc3e8c99d18e1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e24 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.641022:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186389.641024:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186389.641026:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186389.641037:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937908736 00000100:00100000:1.0:1784186389.641051:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937908736 00010000:00010000:1.0:1784186389.641079:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda504a00/0x55bc3e8c99d18e94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e8d expref: 13 pid: 5777 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.641093:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186389.641100:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937908864:0@lo:103: 00000100:00100000:1.0:1784186389.641100:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784186389.641107:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:3306:x1870854937908736:12345-0@lo:103: 00010000:00010000:1.0:1784186389.641117:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784186389.641122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784186389.641122:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda504a00/0x55bc3e8c99d18e94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e8d expref: 13 pid: 5777 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.641138:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda504a00/0x55bc3e8c99d18e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e8d expref: 13 pid: 5777 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.641152:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda504a00/0x55bc3e8c99d18e94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18e8d expref: 13 pid: 5777 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.641166:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186389.641206:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1784186389.641206:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3306:x1870854937908736:12345-0@lo:103: Request processed in 99us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.641211:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+4:5774:x1870854937908480:12345-0@lo:104: Request processed in 472us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186389.641213:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784186389.641217:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784186389.641231:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784186389.641234:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937908864 00000100:00100000:2.0:1784186389.641237:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:5774:x1870854937908608:12345-0@lo:104: 00000100:00100000:1.0:1784186389.641237:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937908864 00010000:00010000:1.0:1784186389.641248:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fca860000/0x55bc3e8c99d18e24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e1d expref: 12 pid: 5775 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641252:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fda505000/0x55bc3e8c99d18e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186389.641259:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784186389.641263:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3306:x1870854937908864:12345-0@lo:103: 00010000:00010000:1.0:1784186389.641270:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186389.641274:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fca860000/0x55bc3e8c99d18e24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e1d expref: 12 pid: 5775 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.641282:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fca860000/0x55bc3e8c99d18e24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e1d expref: 12 pid: 5775 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641286:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784186389.641290:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:5774:x1870854937908608:12345-0@lo:104: Request processed in 55us (917us total) trans 0 rc 0/0 00010000:00010000:1.0:1784186389.641292:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fca860000/0x55bc3e8c99d18e24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18e1d expref: 12 pid: 5775 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186389.641296:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784186389.641301:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186389.641320:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186389.641324:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fda505000/0x55bc3e8c99d18e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641331:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505000 already unused, calling callback (ffffffffc1d84c20) 00000100:00100000:1.0:1784186389.641333:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6759c-e30b-4013-88b9-0b4d132afa93+11:3306:x1870854937908864:12345-0@lo:103: Request processed in 69us (209us total) trans 0 rc 0/0 10000000:00010000:2.0:1784186389.641334:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda505000/0x55bc3e8c99d18e01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641341:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fda505000/0x55bc3e8c99d18e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186389.641343:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 10000000:00010000:2.0:1784186389.641348:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda505000/0x55bc3e8c99d18e01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186389.641354:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784186389.641368:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fda505000/0x55bc3e8c99d18e01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641374:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784186389.641387:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fda505000/0x55bc3e8c99d18e01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641393:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fda505000/0x55bc3e8c99d18e01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18e08 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.641567:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937908864:0@lo:103: 00000100:00100000:3.0:1784186389.641575:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937908736:0@lo:103: 00010000:00010000:0.0:1784186389.641723:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186389.641741:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937908608:0@lo:104: 00010000:00010000:0.0:1784186389.641772:0:5774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186389.641796:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937908992:0@lo:103: 00010000:00010000:2.0:1784186389.641812:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186389.641814:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186389.641816:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186389.641824:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186389.641837:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937908992 00000100:00100000:2.0:1784186389.641841:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937908992 00010000:00010000:2.0:1784186389.641856:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc27ed200/0x55bc3e8c99d18e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e01 expref: 11 pid: 5777 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186389.641884:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784186389.641891:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+11:3308:x1870854937908992:12345-0@lo:103: 00010000:00010000:2.0:1784186389.641899:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186389.641903:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc27ed200/0x55bc3e8c99d18e08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e01 expref: 11 pid: 5777 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641912:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc27ed200/0x55bc3e8c99d18e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18e01 expref: 11 pid: 5777 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641924:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27ed200/0x55bc3e8c99d18e08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18e01 expref: 11 pid: 5777 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641937:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641944:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641956:0:5767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641962:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641975:0:5767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641981:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641987:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fca861400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186389.641990:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.641998:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.642015:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.642032:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784186389.642032:0:5774:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186389.642049:0:5774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186389.642067:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+10:3308:x1870854937908992:12345-0@lo:103: Request processed in 177us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.642073:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784186389.642135:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937908992:0@lo:103: 00010000:00010000:0.0:1784186389.642183:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fca861400/0x55bc3e8c99d18eef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784186389.642197:0:5774:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784186389.721202:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+9:6579:x1870854937908224:12345-0@lo:253: Request processed in 98553us (99150us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186389.721344:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937908224:0@lo:253: 10000000:01000000:3.0:1784186389.721361:0:6579:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784186389.721364:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784186389.721366:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784186389.721367:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784186389.721368:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1784186389.721383:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784186389.721385:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784186389.721386:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784186389.721388:0:6579:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784186389.721390:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784186389.721391:0:6579:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784186389.721430:0:6579:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b9ffef01800 from lustre-OST0000 10000000:01000000:3.0:1784186389.721731:0:6579:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1784186389.721735:0:6579:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784186389.721744:0:6579:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b9fc7763380 local copy 10000000:01000000:3.0:1784186389.721749:0:6579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784186389.721796:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.721881:0:6579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.721893:0:6579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.721913:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909120:0@lo:101: 00000100:00100000:3.0:1784186389.721957:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.722010:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcce7c600 going to sleep for 11 seconds 00000100:00100000:2.0:1784186389.722345:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937909120 00000100:00100000:2.0:1784186389.722353:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937909120 00000100:00100000:2.0:1784186389.722401:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784186389.722411:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+10:6579:x1870854937909120:12345-0@lo:101: 00010000:00010000:2.0:1784186389.722432:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186389.722486:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda505000/0x55bc3e8c99d18efd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18ef6 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.722509:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda505000/0x55bc3e8c99d18efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18ef6 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.722529:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda505000/0x55bc3e8c99d18efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18ef6 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.722538:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505000, rc 0) 00000100:00100000:2.0:1784186389.722762:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+11:6579:x1870854937909120:12345-0@lo:101: Request processed in 352us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.722771:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784186389.722942:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909120:0@lo:101: 00010000:00010000:3.0:1784186389.722959:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.722970:0:6579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.723199:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909248:0@lo:501: 00000100:00100000:3.0:1784186389.723306:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.723345:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcce7c600 going to sleep for 11 seconds 00000100:00100000:0.0:1784186389.723662:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784186389.723696:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937909248 00000100:00100000:0.0:1784186389.723701:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937909248 00000100:00100000:0.0:1784186389.723733:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784186389.723741:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+10:6579:x1870854937909248:12345-0@lo:501: 00000100:00100000:0.0:1784186389.724160:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+10:6579:x1870854937909248:12345-0@lo:501: Request processed in 417us (850us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784186389.724168:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784186389.724373:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909248:0@lo:501: 10000000:01000000:3.0:1784186389.724392:0:6579:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784186389.724434:0:6579:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784186389.724715:0:6579:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.724727:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.724735:0:6579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.724750:0:6579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784186389.724770:0:6579:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b9ffef01800 10000000:01000000:3.0:1784186389.724775:0:6579:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784186389.724779:0:6579:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b9fc7763380 10000000:01000000:3.0:1784186389.724782:0:6579:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784186389.724785:0:6579:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9b9fc7763380 from 1 10000000:01000000:3.0:1784186389.724788:0:6579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784186389.725026:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fca861400/0x55bc3e8c99d18f04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.725037:0:6579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fca861400/0x55bc3e8c99d18f04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.725188:0:6579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fca861400/0x55bc3e8c99d18f04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.725209:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909376:0@lo:101: 00000100:00100000:3.0:1784186389.725638:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.725675:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcce7ca80 going to sleep for 11 seconds 00010000:00010000:0.0:1784186389.725751:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186389.725760:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186389.725781:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fca861600 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186389.725785:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186389.725795:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186389.725873:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186389.725881:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186389.725906:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186389.725925:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186389.725949:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186389.725957:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fca861600/0x55bc3e8c99d18ef6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x55bc3e8c99d18efd expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186389.725973:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186389.725975:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186389.725977:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186389.727644:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937909376 00000100:00100000:2.0:1784186389.727658:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937909376 00000100:00100000:2.0:1784186389.727713:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784186389.727724:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+10:6579:x1870854937909376:12345-0@lo:101: 00010000:00010000:2.0:1784186389.727742:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186389.727764:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda504a00/0x55bc3e8c99d18f0b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18f04 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.727790:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda504a00/0x55bc3e8c99d18f0b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f04 expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.727801:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda504a00/0x55bc3e8c99d18f0b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f04 expref: 11 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.727907:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937909504:0@lo:103: 00000100:00100000:3.0:1784186389.727974:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.728035:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937909504 00010000:00010000:2.0:1784186389.728290:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504a00, rc 0) 00000100:00100000:3.0:1784186389.728481:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937909504 00000100:00100000:3.0:1784186389.728529:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784186389.728537:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3309:x1870854937909504:12345-0@lo:103: 00010000:00010000:3.0:1784186389.728616:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186389.728632:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda505000/0x55bc3e8c99d18efd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d18ef6 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.728650:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186389.728684:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6759c-e30b-4013-88b9-0b4d132afa93+11:3309:x1870854937909504:12345-0@lo:103: Request processed in 148us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186389.728692:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784186389.728734:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937909504:0@lo:103: 00000100:00100000:2.0:1784186389.728922:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+10:6579:x1870854937909376:12345-0@lo:101: Request processed in 1200us (3588us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.728928:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784186389.729992:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909376:0@lo:101: 00010000:00010000:0.0:1784186389.730017:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fca861400/0x55bc3e8c99d18f04 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f0b expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186389.730029:0:6579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fca861400/0x55bc3e8c99d18f04 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18f0b expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186389.730190:0:6579:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784186389.730313:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fca861400/0x55bc3e8c99d18f04 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f0b expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186389.730323:0:6579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fca861400/0x55bc3e8c99d18f04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f0b expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186389.730339:0:6579:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784186389.730346:0:6579:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784186389.730352:0:6579:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1784186389.730355:0:6579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784186389.730385:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186389.730393:0:6579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186389.730402:0:6579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186389.730430:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909632:0@lo:101: 00000100:00100000:0.0:1784186389.730535:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186389.730699:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5452240 going to sleep for 11 seconds 00000100:00100000:2.0:1784186389.730938:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937909632 00000100:00100000:2.0:1784186389.730945:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937909632 00000100:00100000:2.0:1784186389.730996:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784186389.731013:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+10:6579:x1870854937909632:12345-0@lo:101: 00010000:00010000:2.0:1784186389.731026:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186389.731048:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d18f19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18f12 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.731183:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d18f19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f12 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.731195:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d18f19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f12 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.731204:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504600, rc 0) 00000100:00100000:2.0:1784186389.731267:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+11:6579:x1870854937909632:12345-0@lo:101: Request processed in 254us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.731274:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784186389.731606:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909632:0@lo:101: 00010000:00010000:1.0:1784186389.731624:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.731633:0:6579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186389.731740:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909760:0@lo:501: 00000100:00100000:1.0:1784186389.731772:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186389.731932:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb245f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186389.731992:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937909760 00000100:00100000:2.0:1784186389.731997:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937909760 00000100:00100000:2.0:1784186389.732032:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784186389.732048:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+11:6579:x1870854937909760:12345-0@lo:501: 00000100:00100000:2.0:1784186389.732430:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+11:6579:x1870854937909760:12345-0@lo:501: Request processed in 379us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.732438:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784186389.733231:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909760:0@lo:501: 00000100:00100000:1.0:1784186389.733274:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909888:0@lo:503: 00000100:00100000:1.0:1784186389.733328:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186389.733361:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb245f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186389.733736:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937909888 00000100:00100000:2.0:1784186389.733742:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937909888 00000100:00100000:2.0:1784186389.733782:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784186389.733790:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+11:6579:x1870854937909888:12345-0@lo:503: 00000100:00100000:2.0:1784186389.734007:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+11:6579:x1870854937909888:12345-0@lo:503: Request processed in 208us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.734024:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784186389.734379:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937909888:0@lo:503: 00000040:00080000:1.0:1784186389.735249:0:6579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784186389.735331:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910016:0@lo:502: 00000100:00100000:1.0:1784186389.735395:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186389.736248:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb245f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186389.736739:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937910016 00000100:00100000:2.0:1784186389.736748:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937910016 00000100:00100000:2.0:1784186389.736896:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784186389.736907:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+11:6579:x1870854937910016:12345-0@lo:502: 00000100:00100000:2.0:1784186389.737350:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+11:6579:x1870854937910016:12345-0@lo:502: Request processed in 435us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.737359:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784186389.737915:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910016:0@lo:502: 00000040:00080000:0.0:1784186389.738944:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1784186389.739010:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1784186389.739163:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1784186389.739295:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1784186389.739406:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1784186389.740299:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1784186389.740980:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910144:0@lo:502: 00000100:00100000:0.0:1784186389.741173:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186389.741401:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5452e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784186389.741721:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937910144 00000100:00100000:2.0:1784186389.741731:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937910144 00000100:00100000:2.0:1784186389.741829:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784186389.741840:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+11:6579:x1870854937910144:12345-0@lo:502: 00000100:00100000:2.0:1784186389.742324:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+11:6579:x1870854937910144:12345-0@lo:502: Request processed in 485us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.742332:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784186389.742478:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910144:0@lo:502: 00000040:00080000:1.0:1784186389.742640:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1784186389.742662:0:6579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1784186389.743871:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784186389.743883:0:6597:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1784186389.743890:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784186389.743893:0:6597:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1784186389.743899:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784186389.743918:0:6597:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b9fc92e4d40) 00000020:00000080:1.0:1784186389.743939:0:6597:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784186389.743944:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784186389.744019:0:6597:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b9ffef01800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1784186389.744027:0:6597:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784186389.744034:0:6597:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x55bc3e8c99d18f27 00010000:00010000:1.0:1784186389.751983:0:6597:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1784186389.754018:0:6597:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1784186389.760209:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1784186389.761805:0:6597:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1784186389.773302:0:6597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1784186389.774719:0:6597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1784186389.779022:0:6597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1784186389.779036:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186389.779053:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186389.779123:0:6597:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1784186389.779128:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784186389.779134:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186389.779135:0:6597:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784186389.779139:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784186389.779140:0:6597:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784186389.779197:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186389.779207:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186389.779209:0:6597:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784186389.779284:0:6597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784186389.782942:0:6579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1784186389.782980:0:6579:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784186389.783005:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.783020:0:6579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186389.789200:0:6579:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9ffef01800 from 1 10000000:01000000:2.0:1784186389.789210:0:6579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784186389.789392:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.789406:0:6579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.789425:0:6579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186389.789639:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910272:0@lo:101: 00000100:00100000:2.0:1784186389.789714:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186389.790024:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808600 going to sleep for 11 seconds 00000100:00100000:1.0:1784186389.790187:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937910272 00000100:00100000:1.0:1784186389.790195:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937910272 00000100:00100000:1.0:1784186389.790261:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784186389.790272:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+11:6579:x1870854937910272:12345-0@lo:101: 00010000:00010000:1.0:1784186389.790286:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186389.790300:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc27eca00/0x55bc3e8c99d18f35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18f2e expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.790324:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27eca00/0x55bc3e8c99d18f35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f2e expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.790357:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc27eca00/0x55bc3e8c99d18f35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f2e expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.790366:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27eca00, rc 0) 00000100:00100000:1.0:1784186389.790412:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937910272:12345-0@lo:101: Request processed in 142us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186389.790427:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784186389.791139:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910272:0@lo:101: 00010000:00010000:2.0:1784186389.791158:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.791168:0:6579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186389.792942:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910400:0@lo:501: 00000100:00100000:2.0:1784186389.792999:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186389.793040:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937910400 00000100:00100000:2.0:1784186389.793047:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937910400 00000100:00100000:2.0:1784186389.793919:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784186389.793929:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937910400:12345-0@lo:501: 00000100:00100000:1.0:1784186389.796010:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808600 going to sleep for 11 seconds 00000100:00100000:2.0:1784186389.796708:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937910400:12345-0@lo:501: Request processed in 2775us (3703us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.796721:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784186389.802211:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910400:0@lo:501: 00000100:00100000:2.0:1784186389.802693:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910528:0@lo:503: 00000100:00100000:2.0:1784186389.802769:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186389.803189:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808540 going to sleep for 11 seconds 00000100:00100000:1.0:1784186389.804215:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937910528 00000100:00100000:1.0:1784186389.804226:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937910528 00000100:00100000:1.0:1784186389.804278:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784186389.804288:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937910528:12345-0@lo:503: 00000100:00100000:1.0:1784186389.804791:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937910528:12345-0@lo:503: Request processed in 502us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186389.804801:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784186389.804983:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910528:0@lo:503: 00000040:00080000:3.0:1784186389.805293:0:6579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784186389.805375:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910656:0@lo:502: 00000100:00100000:3.0:1784186389.805421:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.805771:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcce7c600 going to sleep for 11 seconds 00000100:00100000:2.0:1784186389.805924:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937910656 00000100:00100000:2.0:1784186389.805930:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937910656 00000100:00100000:2.0:1784186389.805960:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784186389.805968:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937910656:12345-0@lo:502: 00000100:00100000:2.0:1784186389.806187:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937910656:12345-0@lo:502: Request processed in 218us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.806195:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784186389.806329:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910656:0@lo:502: 00000040:00080000:3.0:1784186389.806758:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1784186389.806827:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1784186389.806859:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910784:0@lo:502: 00000100:00100000:3.0:1784186389.806898:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.806926:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc76969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186389.807067:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937910784 00000100:00100000:1.0:1784186389.807072:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937910784 00000100:00100000:1.0:1784186389.807111:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784186389.807119:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937910784:12345-0@lo:502: 00000100:00100000:1.0:1784186389.807277:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937910784:12345-0@lo:502: Request processed in 158us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186389.807284:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784186389.807692:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910784:0@lo:502: 00000040:00080000:3.0:1784186389.807820:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1784186389.807836:0:6579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784186389.809691:0:6601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784186389.809705:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186389.809707:0:6601:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784186389.809714:0:6601:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9ffef01800 00000020:00000080:3.0:1784186389.809716:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784186389.809736:0:6601:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186389.809740:0:6601:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186389.809741:0:6601:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784186389.809744:0:6601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784186389.809962:0:6579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784186389.809985:0:6579:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784186389.810010:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.810034:0:6579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186389.810134:0:6579:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784186389.810138:0:6579:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b9ffef01800 10000000:01000000:1.0:1784186389.810141:0:6579:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b9ffef01800 10000000:01000000:1.0:1784186389.810145:0:6579:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784186389.810151:0:6579:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9ffef01800 from 1 10000000:01000000:1.0:1784186389.810154:0:6579:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784186389.810190:0:6579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.810198:0:6579:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.810209:0:6579:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186389.810232:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910912:0@lo:101: 00000100:00100000:1.0:1784186389.810291:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186389.810413:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0861480 going to sleep for 11 seconds 00000100:00100000:2.0:1784186389.810975:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937910912 00000100:00100000:2.0:1784186389.810985:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937910912 00000100:00100000:2.0:1784186389.811073:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784186389.811084:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937910912:12345-0@lo:101: 00010000:00010000:2.0:1784186389.811099:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186389.811112:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda504800/0x55bc3e8c99d18f43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18f3c expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.811136:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda504800/0x55bc3e8c99d18f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f3c expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.811147:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda504800/0x55bc3e8c99d18f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f3c expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186389.811156:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504800, rc 0) 00000100:00100000:2.0:1784186389.811211:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6579:x1870854937910912:12345-0@lo:101: Request processed in 128us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.811218:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784186389.811296:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd541f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937910912:0@lo:101: 00010000:00010000:3.0:1784186389.811314:0:6579:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.811334:0:6579:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.811435:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937911040:0@lo:501: 00000100:00100000:3.0:1784186389.811513:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.811808:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcce7cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784186389.811937:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937911040 00000100:00100000:1.0:1784186389.811942:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937911040 00000100:00100000:1.0:1784186389.811966:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784186389.811973:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6579:x1870854937911040:12345-0@lo:501: 00000100:00100000:1.0:1784186389.812344:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6579:x1870854937911040:12345-0@lo:501: Request processed in 369us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186389.812352:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784186389.812672:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937911040:0@lo:501: 00000100:00100000:3.0:1784186389.812707:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937911168:0@lo:503: 00000100:00100000:3.0:1784186389.812751:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.812880:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcce7cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186389.812914:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937911168 00000100:00100000:2.0:1784186389.812919:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937911168 00000100:00100000:2.0:1784186389.812991:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784186389.813000:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6579:x1870854937911168:12345-0@lo:503: 00000100:00100000:2.0:1784186389.813243:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6579:x1870854937911168:12345-0@lo:503: Request processed in 244us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186389.813250:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784186389.813321:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937911168:0@lo:503: 00000040:00080000:3.0:1784186389.813653:0:6579:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784186389.813723:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937911296:0@lo:502: 00000100:00100000:3.0:1784186389.813759:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.814203:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb245a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186389.814271:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937911296 00000100:00100000:1.0:1784186389.814278:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937911296 00000100:00100000:1.0:1784186389.814307:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784186389.814314:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6579:x1870854937911296:12345-0@lo:502: 00000100:00100000:3.0:1784186389.814839:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6579:x1870854937911296:12345-0@lo:502: Request processed in 524us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186389.814847:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784186389.814999:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937911296:0@lo:502: 00000040:00080000:1.0:1784186389.815302:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784186389.815359:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784186389.815395:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784186389.815498:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784186389.815540:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784186389.815877:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784186389.815924:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784186389.815956:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784186389.815998:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784186389.816033:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784186389.816124:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784186389.816175:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784186389.816213:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784186389.816246:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784186389.816293:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784186389.816328:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784186389.816359:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784186389.816399:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784186389.816434:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784186389.816660:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784186389.816728:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784186389.816765:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784186389.816931:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784186389.816979:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784186389.817015:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1784186389.817049:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1784186389.817122:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1784186389.817159:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1784186389.817215:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937911424:0@lo:502: 00000100:00100000:1.0:1784186389.817297:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186389.817349:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0861a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186389.817582:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937911424 00000100:00100000:3.0:1784186389.817590:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937911424 00000100:00100000:3.0:1784186389.817630:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784186389.817638:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6579:x1870854937911424:12345-0@lo:502: 00000100:00100000:3.0:1784186389.817969:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6579:x1870854937911424:12345-0@lo:502: Request processed in 330us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186389.817977:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784186389.818197:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937911424:0@lo:502: 00000040:00080000:1.0:1784186389.818272:0:6579:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1784186389.818282:0:6579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1784186389.819118:0:6602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784186389.819132:0:6602:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b9fc7764d40) 00000020:00000080:3.0:1784186389.819153:0:6602:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1784186389.819322:0:6602:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b9ffef01800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784186389.819327:0:6602:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b9ffef01800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784186389.819331:0:6602:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9ffef01800 3 00010000:00080000:3.0:1784186389.819358:0:6602:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b9ec4a85000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1784186389.832150:0:6602:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1784186389.832275:0:6602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784186389.832313:0:6602:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784186389.832327:0:6602:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x55bc3e8c99d18f51 00000100:00080000:3.0:1784186389.832338:0:6602:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784186389.832343:0:6602:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b9ec4a85000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1784186389.832378:0:6602:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9fc9c59500 x1870854937911552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784186389.832406:0:6602:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784186389.832650:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1870854937911552:0@lo:38: 00000100:00100000:1.0:1784186389.832720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186389.832797:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937911552 00000100:00100000:1.0:1784186389.832803:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937911552 00000100:00100000:1.0:1784186389.832833:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784186389.832840:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1870854937911552:12345-0@lo:38: 00010000:00080000:1.0:1784186389.832863:0:5784:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:1.0:1784186389.832894:0:5784:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x55bc3e8c99d18f58 00000004:00100000:1.0:1784186389.832908:0:5784:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784186389.832934:0:5784:0:(import.c:65:import_set_state_nolock()) ffff9b9ec48a6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784186389.832978:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870854937911552:12345-0@lo:38: Request processed in 137us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186389.832986:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784186389.833027:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b9fc9c59500 x1870854937911552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784186399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186389.833037:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784186389.833044:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1784186389.833051:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784186389.833066:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784186389.833075:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9ec4a85000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784186389.833081:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1870854937911552:0@lo:38: 00000040:00080000:3.0:1784186389.835293:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1784186389.835411:0:6579:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1784186389.835478:0:6579:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784186389.835496:0:6579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.835508:0:6579:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784186389.835679:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784186389.835682:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784186389.835683:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784186389.835684:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784186389.835686:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784186389.835687:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784186389.835689:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784186389.835690:0:6579:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784186389.835692:0:6579:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784186389.835693:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784186389.835695:0:6579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784186389.835699:0:6579:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1784186389.835701:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784186389.835703:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784186389.835704:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784186389.835705:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784186389.835706:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784186389.835707:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784186389.835708:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784186389.835709:0:6579:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784186389.835710:0:6579:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784186389.835711:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784186389.835712:0:6579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784186389.835734:0:6579:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784186389.835750:0:6579:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd541880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937911680:0@lo:253: 00000100:00100000:1.0:1784186389.835828:0:6579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186389.835866:0:6579:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0861300 going to sleep for 11 seconds 00000100:00100000:3.0:1784186389.835983:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937911680 00000100:00100000:3.0:1784186389.835989:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937911680 00000100:00100000:3.0:1784186389.836033:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784186389.836041:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6579:x1870854937911680:12345-0@lo:253: 20000000:01000000:3.0:1784186389.836075:0:5774:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784186389.836088:0:5774:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784186389.837117:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186389.837130:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937911808:0@lo:400: 00000100:00100000:0.0:1784186389.837173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186389.837215:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937911808 00000100:00100000:0.0:1784186389.837220:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937911808 00000100:00100000:0.0:1784186389.837249:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784186389.837255:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937911808:12345-0@lo:400: 00000100:00100000:0.0:1784186389.837295:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937911808:12345-0@lo:400: Request processed in 40us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186389.837302:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784186389.837336:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b9ffd9ddc00 x1870854937911808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186389.837349:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937911808:0@lo:400: 20000000:01000000:3.0:1784186389.864650:0:5774:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784186389.864675:0:5774:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784186389.864894:0:5798:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784186389.864900:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784186389.864924:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.864943:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18ebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18eb7 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.864952:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.864997:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18eb7 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186389.865011:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18ebe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18eb7 expref: 13 pid: 5775 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186389.865025:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd541500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5798:1870854937911936:0@lo:104: 00000100:00100000:1.0:1784186389.865100:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186389.865151:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0861480 going to sleep for 11 seconds 00000100:00100000:3.0:1784186389.865640:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937911936 00000100:00100000:3.0:1784186389.865650:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937911936 00000100:00100000:3.0:1784186389.865703:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186389.865712:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+3:5798:x1870854937911936:12345-0@lo:104: 00010000:00010000:3.0:1784186389.865741:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d18eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.865816:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784186389.865823:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+3:5798:x1870854937911936:12345-0@lo:104: Request processed in 112us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186389.865830:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1784186389.865852:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186389.865857:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d18eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.865864:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505e00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:3.0:1784186389.865868:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d18eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.865876:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d18eb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784186389.865884:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d18eb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186389.865890:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784186389.865918:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d18eb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.865925:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784186389.865942:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d18eb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.865949:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d18eb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18ebe expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.865971:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186389.865973:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186389.865975:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186389.865987:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937912064:0@lo:103: 00000100:00100000:3.0:1784186389.866020:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186389.866067:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937912064 00000100:00100000:3.0:1784186389.866071:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937912064 00010000:00010000:3.0:1784186389.866088:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18ebe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18eb7 expref: 14 pid: 5775 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.866110:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186389.866116:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe55b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:3307:x1870854937912064:12345-0@lo:103: 00010000:00010000:3.0:1784186389.866126:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186389.866131:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18ebe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18eb7 expref: 14 pid: 5775 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866141:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18ebe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18eb7 expref: 14 pid: 5775 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866158:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866166:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784186389.866180:0:5767:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002844353s 00010000:00010000:3.0:1784186389.866185:0:5767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866201:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866208:0:5767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866214:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866218:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186389.866221:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866228:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866236:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866244:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186389.866273:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe55b2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:3307:x1870854937912064:12345-0@lo:103: Request processed in 156us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186389.866280:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186389.866344:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937912064:0@lo:103: 00010000:00010000:3.0:1784186389.866376:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18ebe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18eb7 expref: 13 pid: 5775 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.866385:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd541500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5798:1870854937911936:0@lo:104: 00010000:00010000:3.0:1784186389.866399:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866414:0:5798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866421:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186389.866426:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d18f5f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186389.880980:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:6579:x1870854937911680:12345-0@lo:253: Request processed in 44928us (45141us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186389.880997:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784186389.881217:0:6579:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd541880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:6579:1870854937911680:0@lo:253: 10000000:01000000:1.0:1784186389.881235:0:6579:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784186389.881238:0:6579:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784186389.881240:0:6579:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784186389.881242:0:6579:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784186389.881243:0:6579:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784186389.881244:0:6579:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784186389.881245:0:6579:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784186389.881247:0:6579:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784186389.881249:0:6579:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784186389.881264:0:6579:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784186389.881266:0:6579:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784186389.881268:0:6579:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784186389.881283:0:6579:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784186389.887772:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784186389.887972:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784186389.888360:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784186389.888773:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784186389.889003:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784186389.889759:0:6579:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784186389.891187:0:6579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1784186390.218865:0:6579:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1784186390.218873:0:6579:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1784186390.218906:0:6579:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784186390.218959:0:6579:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784186390.218978:0:6579:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1784186390.219007:0:6579:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1784186390.525678:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186391.552999:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186392.574567:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784186393.341755:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784186393.341763:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9fc5f8f800 from 21 10000000:01000000:3.0:1784186393.341768:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784186393.341817:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186393.341829:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186393.341839:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186393.341876:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937912192:0@lo:101: 00000100:00100000:3.0:1784186393.342370:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186393.342990:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58600 going to sleep for 11 seconds 00000100:00100000:1.0:1784186393.352340:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937912192 00000100:00100000:1.0:1784186393.352352:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937912192 00000100:00100000:1.0:1784186393.352488:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784186393.352500:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5780:x1870854937912192:12345-0@lo:101: 00010000:00010000:1.0:1784186393.352518:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186393.352536:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d18f6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18f66 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186393.352563:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d18f6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f66 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186393.352571:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d18f6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f66 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186393.352578:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ece00, rc 0) 00000100:00100000:1.0:1784186393.352647:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937912192:12345-0@lo:101: Request processed in 151us (10279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186393.352652:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784186393.353725:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937912192:0@lo:101: 00010000:00010000:0.0:1784186393.353751:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.353764:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186393.353850:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937912320:0@lo:501: 00000100:00100000:0.0:1784186393.353897:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186393.353917:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937912320 00000100:00100000:3.0:1784186393.353923:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937912320 00000100:00100000:0.0:1784186393.353940:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186393.353967:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784186393.353974:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937912320:12345-0@lo:501: 00000100:00100000:3.0:1784186393.354299:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937912320:12345-0@lo:501: Request processed in 324us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186393.354307:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784186393.355313:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937912320:0@lo:501: 00000100:00100000:0.0:1784186393.355366:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937912448:0@lo:503: 00000100:00100000:0.0:1784186393.355458:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.355485:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186393.357472:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937912448 00000100:00100000:3.0:1784186393.357488:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937912448 00000100:00100000:3.0:1784186393.357545:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784186393.357554:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937912448:12345-0@lo:503: 00000100:00100000:3.0:1784186393.357869:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937912448:12345-0@lo:503: Request processed in 316us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186393.357875:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784186393.358585:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937912448:0@lo:503: 00000100:00100000:3.0:1784186393.359567:0:6759:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6759:1870854937912576:0@lo:502: 00000100:00100000:0.0:1784186393.359680:0:6759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.359721:0:6759:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58540 going to sleep for 11 seconds 00000100:00100000:3.0:1784186393.359766:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937912576 00000100:00100000:3.0:1784186393.359771:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937912576 00000100:00100000:3.0:1784186393.359808:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784186393.359815:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6759:x1870854937912576:12345-0@lo:502: 00000100:00100000:3.0:1784186393.360099:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6759:x1870854937912576:12345-0@lo:502: Request processed in 283us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186393.360107:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784186393.360241:0:6759:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6759:1870854937912576:0@lo:502: 00000100:00100000:0.0:1784186393.360279:0:6759:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6759:1870854937912704:0@lo:502: 00000100:00100000:0.0:1784186393.360302:0:6759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.360328:0:6759:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186393.361677:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937912704 00000100:00100000:3.0:1784186393.361690:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937912704 00000100:00100000:3.0:1784186393.361788:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784186393.361799:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6759:x1870854937912704:12345-0@lo:502: 00000100:00100000:3.0:1784186393.362052:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:6759:x1870854937912704:12345-0@lo:502: Request processed in 255us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186393.362059:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784186393.363561:0:6759:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6759:1870854937912704:0@lo:502: 00000040:00080000:1.0:1784186393.363603:0:6759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1784186393.363740:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1784186393.363761:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784186393.363771:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.363780:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186393.363834:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784186393.363837:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b9fc5f8f800 from 4 10000000:01000000:0.0:1784186393.363839:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784186393.363875:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.363882:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.363889:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186393.363904:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937912832:0@lo:101: 00000100:00100000:0.0:1784186393.363954:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.365141:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651db40 going to sleep for 11 seconds 00000100:00100000:3.0:1784186393.366798:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937912832 00000100:00100000:3.0:1784186393.366813:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937912832 00000100:00100000:3.0:1784186393.366874:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784186393.366885:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937912832:12345-0@lo:101: 00010000:00010000:3.0:1784186393.366903:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186393.366927:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18f7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18f74 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186393.366960:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18f7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f74 expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186393.366972:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18f7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f74 expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186393.366982:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fca861e00, rc 0) 00000100:00100000:3.0:1784186393.367069:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937912832:12345-0@lo:101: Request processed in 186us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186393.367076:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784186393.367151:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937912832:0@lo:101: 00010000:00010000:0.0:1784186393.367173:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.367185:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186393.367313:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937912960:0@lo:256: 00000100:00100000:0.0:1784186393.367348:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.367384:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651db40 going to sleep for 11 seconds 00000100:00100000:0.0:1784186393.367400:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937912960 00000100:00100000:0.0:1784186393.367405:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937912960 00000100:00100000:0.0:1784186393.367432:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784186393.367459:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937912960:12345-0@lo:256: 20000000:01000000:0.0:1784186393.367474:0:5774:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784186393.367491:0:5774:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784186393.367494:0:5774:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1784186393.367578:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937912960:12345-0@lo:256: Request processed in 139us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186393.367585:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784186393.367619:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937912960:0@lo:256: 10000000:01000000:0.0:1784186393.367659:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784186393.367667:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.367675:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186393.367684:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784186393.367686:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1784186393.367689:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784186393.367710:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.367718:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.367728:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186393.367739:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937913088:0@lo:101: 00000100:00100000:0.0:1784186393.367756:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.367776:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651db40 going to sleep for 11 seconds 00000100:00100000:3.0:1784186393.368485:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937913088 00000100:00100000:3.0:1784186393.368494:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937913088 00000100:00100000:3.0:1784186393.368524:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784186393.368532:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937913088:12345-0@lo:101: 00010000:00010000:3.0:1784186393.368548:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186393.368563:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fca860e00/0x55bc3e8c99d18f89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18f82 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186393.368585:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fca860e00/0x55bc3e8c99d18f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f82 expref: 15 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186393.368596:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fca860e00/0x55bc3e8c99d18f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f82 expref: 15 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186393.368605:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fca860e00, rc 0) 00000100:00100000:3.0:1784186393.368648:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937913088:12345-0@lo:101: Request processed in 118us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186393.368655:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784186393.368710:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937913088:0@lo:101: 00010000:00010000:0.0:1784186393.368725:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.368743:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186393.368848:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937913216:0@lo:501: 00000100:00100000:0.0:1784186393.368870:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.368896:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651db40 going to sleep for 11 seconds 00000100:00100000:2.0:1784186393.368926:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937913216 00000100:00100000:2.0:1784186393.368931:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937913216 00000100:00100000:2.0:1784186393.368954:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784186393.368960:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937913216:12345-0@lo:501: 00000100:00100000:2.0:1784186393.374728:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937913216:12345-0@lo:501: Request processed in 5755us (5843us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186393.374745:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784186393.377612:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937913216:0@lo:501: 00000100:00100000:0.0:1784186393.377679:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937913344:0@lo:503: 00000100:00100000:0.0:1784186393.377767:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.377833:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651db40 going to sleep for 11 seconds 00000100:00100000:3.0:1784186393.378488:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937913344 00000100:00100000:3.0:1784186393.378498:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937913344 00000100:00100000:3.0:1784186393.378551:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784186393.378562:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937913344:12345-0@lo:503: 00000100:00100000:3.0:1784186393.378957:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937913344:12345-0@lo:503: Request processed in 396us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186393.378965:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784186393.379260:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937913344:0@lo:503: 00000100:00100000:3.0:1784186393.379862:0:6762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6762:1870854937913472:0@lo:502: 00000100:00100000:3.0:1784186393.379913:0:6762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186393.379949:0:6762:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58540 going to sleep for 11 seconds 00000100:00100000:2.0:1784186393.383520:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937913472 00000100:00100000:2.0:1784186393.383535:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937913472 00000100:00100000:2.0:1784186393.383600:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784186393.383612:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:6762:x1870854937913472:12345-0@lo:502: 00000100:00100000:2.0:1784186393.383972:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:6762:x1870854937913472:12345-0@lo:502: Request processed in 362us (4058us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186393.383980:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784186393.384004:0:6762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6762:1870854937913472:0@lo:502: 00000020:01000000:3.0:1784186393.384035:0:6762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784186393.384042:0:6762:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1784186393.384055:0:6762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186393.384057:0:6762:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784186393.384062:0:6762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784186393.384066:0:6762:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:3.0:1784186393.384089:0:6762:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784186393.384092:0:6762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784186393.384117:0:6762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9b9fd18519c0) 00000020:00000080:3.0:1784186393.384138:0:6762:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1784186393.384145:0:6762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784186393.384224:0:6762:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1784186393.384229:0:6762:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784186393.384235:0:6762:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d18f97 00010000:00080000:3.0:1784186393.384263:0:6762:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b9fc364e000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1784186393.384549:0:6762:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1784186393.446703:0:6762:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1784186393.446728:0:6762:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784186393.447328:0:6762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784186393.447672:0:6762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784186393.447720:0:6762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1784186393.447775:0:6762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1784186393.453715:0:6766:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784186393.453724:0:6766:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784186393.459171:0:6762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784186393.459190:0:6762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784186393.459241:0:6762:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784186393.459263:0:6762:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x55bc3e8c99d18f9e 00000100:00080000:0.0:1784186393.459274:0:6762:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784186393.459280:0:6762:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b9fc364e000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:0.0:1784186393.459317:0:6762:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffd9ddf80 x1870854937913600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784186393.459359:0:6762:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1784186393.459384:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937913600:0@lo:8: 00000020:01000000:0.0:1784186393.459476:0:6762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1784186393.459480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1784186393.459480:0:6762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186393.459482:0:6762:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784186393.459485:0:6762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186393.459489:0:6762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186393.459490:0:6762:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784186393.459493:0:6762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784186393.459495:0:6762:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784186393.459516:0:6762:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6762:1870854937913728:0@lo:502: 00000100:00100000:1.0:1784186393.459545:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937913600 00000100:00100000:1.0:1784186393.459552:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937913600 00000100:00100000:0.0:1784186393.459554:0:6762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.459574:0:6762:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186393.459580:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784186393.459587:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1870854937913600:12345-0@lo:8: 00000100:00100000:0.0:1784186393.459588:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937913728 00000100:00100000:0.0:1784186393.459591:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937913728 00010000:00080000:1.0:1784186393.459612:0:6581:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000100:00100000:0.0:1784186393.459616:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784186393.459621:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:6762:x1870854937913728:12345-0@lo:502: 00000020:00000080:1.0:1784186393.459634:0:6581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x55bc3e8c99d18fa5 00002000:00100000:1.0:1784186393.459661:0:6581:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b9ec48a7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784186393.459666:0:6581:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1784186393.459669:0:6581:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1784186393.459775:0:6581:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1784186393.459838:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:6762:x1870854937913728:12345-0@lo:502: Request processed in 216us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186393.459846:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784186393.459908:0:6762:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:6762:1870854937913728:0@lo:502: 00002000:00080000:1.0:1784186393.459915:0:6581:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:01000000:0.0:1784186393.459930:0:6762:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186393.459933:0:6762:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00080000:1.0:1784186393.459934:0:6581:0:(import.c:65:import_set_state_nolock()) ffff9b9ec48a0000 : changing import state from RECOVER to FULL 00000020:00000080:0.0:1784186393.459935:0:6762:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784186393.459939:0:6762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1784186393.459971:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1870854937913600:12345-0@lo:8: Request processed in 383us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186393.459977:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784186393.460007:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffd9ddf80 x1870854937913600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784186403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186393.460015:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784186393.460021:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784186393.460026:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784186393.460031:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000020:01000000:0.0:1784186393.460032:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00000100:00080000:1.0:1784186393.460033:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fc364e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784186393.460042:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784186393.460046:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937913600:0@lo:8: 10000000:01000000:0.0:1784186393.460050:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784186393.460058:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.460077:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186393.460087:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784186393.460089:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b9fc7763380 from 1 10000000:01000000:0.0:1784186393.460092:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:1.0:1784186393.460097:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937913856:0@lo:400: 00010000:00010000:0.0:1784186393.460110:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.460117:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186393.460121:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784186393.460125:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186393.460136:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937914112:0@lo:101: 00000100:00100000:1.0:1784186393.460138:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784186393.460142:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937913984:0@lo:400: 00000100:00100000:0.0:1784186393.460158:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186393.460159:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.460172:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784186393.460182:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937914112 00000100:00100000:0.0:1784186393.460185:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937914112 00000100:00100000:1.0:1784186393.460187:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937913856 00000100:00100000:1.0:1784186393.460195:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937913856 00000100:00100000:0.0:1784186393.460204:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784186393.460209:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937914112:12345-0@lo:101: 00000100:00100000:1.0:1784186393.460215:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937913984 00000100:00100000:1.0:1784186393.460217:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937913984 00010000:00010000:0.0:1784186393.460217:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186393.460228:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d18fb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18fac expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186393.460237:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784186393.460242:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937913856:12345-0@lo:400: 00010000:00010000:0.0:1784186393.460247:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d18fb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18fac expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.460267:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d18fb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18fac expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186393.460273:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937913856:12345-0@lo:400: Request processed in 31us (151us total) trans 0 rc 0/0 00010000:00010000:0.0:1784186393.460276:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129600, rc 0) 00000100:00100000:1.0:1784186393.460278:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784186393.460291:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784186393.460298:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937913984:12345-0@lo:400: 00000100:00100000:0.0:1784186393.460299:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937914112:12345-0@lo:101: Request processed in 90us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186393.460304:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784186393.460321:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937913984:12345-0@lo:400: Request processed in 24us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186393.460326:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784186393.460328:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937914112:0@lo:101: 00010000:00010000:0.0:1784186393.460339:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784186393.460348:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784186393.460348:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1784186393.460362:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffd543480 x1870854937913984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186393.460371:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937913984:0@lo:400: 00010000:00080000:1.0:1784186393.460379:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffd542d80 x1870854937913856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186393.460381:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937914240:0@lo:501: 00000100:00100000:1.0:1784186393.460387:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937913856:0@lo:400: 00000100:00100000:0.0:1784186393.460403:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.460431:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784186393.460461:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937914240 00000100:00100000:0.0:1784186393.460464:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937914240 00000100:00100000:0.0:1784186393.460484:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784186393.460489:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937914240:12345-0@lo:501: 00000100:00100000:0.0:1784186393.460660:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937914240:12345-0@lo:501: Request processed in 169us (254us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784186393.460666:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784186393.460695:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937914240:0@lo:501: 10000000:01000000:0.0:1784186393.460712:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784186393.460721:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186393.460728:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784186393.460779:0:6766:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784186393.460896:0:6766:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 172182453881ns, next at 0ns, rc = 0 00000004:00080000:0.0:1784186393.525728:0:6767:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1784186393.525762:0:6767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1870854937914496:0@lo:7: 00000100:00100000:0.0:1784186393.525834:0:6767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.525883:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937914496 00000100:00100000:0.0:1784186393.525889:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937914496 00000100:00100000:0.0:1784186393.525957:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784186393.525966:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6767:x1870854937914496:12345-0@lo:7: 00000100:00100000:3.0:1784186393.526838:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937914368:0@lo:13: 00000100:00100000:3.0:1784186393.526888:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186393.526951:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937914368 00000100:00100000:3.0:1784186393.526957:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937914368 00000100:00100000:3.0:1784186393.526985:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784186393.526992:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1870854937914368:12345-0@lo:13: 00002000:00000024:3.0:1784186393.527018:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1784186393.527059:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1870854937914368:12345-0@lo:13: Request processed in 68us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186393.527066:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784186393.527102:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffd9df800 x1870854937914368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186393.527120:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937914368:0@lo:13: 00000100:00080000:1.0:1784186393.527846:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784186393.532663:0:6767:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651d3c0 going to sleep for 11 seconds 00002000:00080000:0.0:1784186393.554321:0:6584:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1784186393.554330:0:6584:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1784186393.554455:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6767:x1870854937914496:12345-0@lo:7: Request processed in 28471us (28604us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186393.554468:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784186393.554524:0:6767:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffd9dd880 x1870854937914496/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784186409 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186393.554540:0:6767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1870854937914496:0@lo:7: 00000004:00080000:0.0:1784186393.554554:0:6767:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1784186393.554594:0:6767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1870854937914624:0@lo:5: 00000100:00100000:0.0:1784186393.554630:0:6767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186393.554669:0:6767:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186393.554687:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937914624 00000100:00100000:0.0:1784186393.554693:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937914624 00000100:00100000:0.0:1784186393.554735:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784186393.554744:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6767:x1870854937914624:12345-0@lo:5: 00002000:00080000:0.0:1784186393.554770:0:6583:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1784186393.554773:0:6583:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1784186393.554970:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6767:x1870854937914624:12345-0@lo:5: Request processed in 227us (339us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784186393.554977:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1784186393.555089:0:6767:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffd9dd880 x1870854937914624/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784186409 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186393.555107:0:6767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1870854937914624:0@lo:5: 00000004:00080000:3.0:1784186393.555115:0:6767:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1784186393.555138:0:6767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1870854937914752:0@lo:700: 00000100:00100000:3.0:1784186393.555162:0:6767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186393.555187:0:6767:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784186393.555236:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937914752 00000100:00100000:2.0:1784186393.555240:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937914752 00000100:00100000:2.0:1784186393.555274:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784186393.555281:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6767:x1870854937914752:12345-0@lo:700: 00000100:00100000:2.0:1784186393.555306:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6590:1870854937914880:0@lo:700: 00000100:00100000:2.0:1784186393.555335:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186393.555477:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc66dda80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186393.558739:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937914880 00000100:00100000:1.0:1784186393.558755:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937914880 00000100:00100000:1.0:1784186393.558807:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784186393.558824:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6590:x1870854937914880:12345-0@lo:700: 00000004:00080000:1.0:1784186393.585203:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1784186393.620102:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1784186393.657659:0:5789:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1784186393.667452:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6590:x1870854937914880:12345-0@lo:700: Request processed in 108608us (112093us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186393.667476:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784186393.667660:0:6590:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffede6300 x1870854937914880/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784186409 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186393.667694:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6590:1870854937914880:0@lo:700: 40000000:02000000:2.0:1784186393.667707:0:6590:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1784186393.719254:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1784186393.719276:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784186393.719389:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6767:x1870854937914752:12345-0@lo:700: Request processed in 164096us (164213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186393.719402:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784186393.720527:0:6767:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9fc9c58380 x1870854937914752/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784186409 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186393.720542:0:6767:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1784186393.720561:0:6767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1870854937914752:0@lo:700: 00000004:02000040:2.0:1784186393.755641:0:6767:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1784186393.759826:0:6767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1870854937915008:0@lo:5: 00000100:00100000:2.0:1784186393.759900:0:6767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186393.759959:0:6767:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc66dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1784186393.760070:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937915008 00000100:00100000:0.0:1784186393.760080:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937915008 00000100:00100000:0.0:1784186393.760144:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784186393.760155:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6767:x1870854937915008:12345-0@lo:5: 00002000:00080000:0.0:1784186393.770366:0:6584:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1784186393.771867:0:6584:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1784186393.779069:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6767:x1870854937915008:12345-0@lo:5: Request processed in 18908us (19160us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784186393.779082:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784186393.779180:0:6767:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffede6300 x1870854937915008/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784186409 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186393.779198:0:6767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6767:1870854937915008:0@lo:5: 00000004:00080000:2.0:1784186393.779213:0:6767:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1784186394.624630:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186395.645755:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186396.673050:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784186396.726995:0:6950:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784186397.693661:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186398.717607:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186398.909893:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937915520:0@lo:400: 00000100:00100000:3.0:1784186398.909967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186398.910029:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186398.910036:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937915136:0@lo:400: 00000100:00100000:3.0:1784186398.910064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186398.910093:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937915264:0@lo:400: 00000100:00100000:3.0:1784186398.910120:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186398.910136:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784186398.910142:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937915392:0@lo:400: 00000100:00100000:3.0:1784186398.910168:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186398.910221:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937915520 00000100:00100000:3.0:1784186398.910228:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937915520 00000100:00100000:3.0:1784186398.910282:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784186398.910290:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937915520:12345-0@lo:400: 00000100:00100000:3.0:1784186398.910365:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937915520:12345-0@lo:400: Request processed in 76us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186398.910379:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1784186398.910401:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784186398.910464:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9fc9c58e00 x1870854937915520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186398.910480:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937915520:0@lo:400: 00000100:00100000:0.0:1784186398.910620:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937915136 00000100:00100000:0.0:1784186398.910625:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937915136 00000100:00100000:0.0:1784186398.910654:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784186398.910661:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+16:3306:x1870854937915136:12345-0@lo:400: 00000100:00100000:0.0:1784186398.910705:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+16:3306:x1870854937915136:12345-0@lo:400: Request processed in 45us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186398.910719:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784186398.911106:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937915648:0@lo:13: 00000100:00100000:0.0:1784186398.911137:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186398.912294:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937915648 00000100:00100000:2.0:1784186398.912308:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937915648 00000100:00100000:2.0:1784186398.912375:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784186398.912384:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854937915648:12345-0@lo:13: 00002000:00000024:2.0:1784186398.912431:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186398.912539:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854937915648:12345-0@lo:13: Request processed in 155us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186398.912547:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784186398.912603:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffede6680 x1870854937915648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186398.912631:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937915648:0@lo:13: 00000100:00100000:1.0:1784186398.912970:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937915264 00000100:00100000:1.0:1784186398.912977:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937915264 00000100:00100000:1.0:1784186398.913013:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937915392 00000100:00100000:1.0:1784186398.913017:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937915392 00000100:00100000:1.0:1784186398.913040:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784186398.913047:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937915264:12345-0@lo:400: 00000100:00100000:1.0:1784186398.913104:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937915264:12345-0@lo:400: Request processed in 57us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186398.913110:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784186398.913126:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784186398.913131:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937915392:12345-0@lo:400: 00000100:00100000:1.0:1784186398.913159:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937915392:12345-0@lo:400: Request processed in 29us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186398.913165:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1784186398.913383:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784186398.913421:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9fc9c58000 x1870854937915392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186398.913434:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937915392:0@lo:400: 00010000:00080000:3.0:1784186398.913472:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9fc9c59c00 x1870854937915264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186398.913481:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937915264:0@lo:400: 00000100:00100000:3.0:1784186398.913518:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937915136:0@lo:400: 00000001:00080000:3.0:1784186399.064555:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1784186399.742830:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186400.765549:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186401.791749:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186402.828882:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186403.837675:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186404.030436:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937915776:0@lo:400: 00000100:00100000:3.0:1784186404.030528:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186404.031386:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784186404.031397:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937915904:0@lo:400: 00000100:00100000:3.0:1784186404.031432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186404.031488:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937916032:0@lo:400: 00000100:00100000:3.0:1784186404.031512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186404.031531:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186404.032634:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784186404.032651:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937916288:0@lo:13: 00000100:00100000:1.0:1784186404.032696:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186404.032734:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937916288 00000100:00100000:1.0:1784186404.032741:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937916288 00000100:00100000:1.0:1784186404.032790:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784186404.032798:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937916288:12345-0@lo:13: 00002000:00000024:1.0:1784186404.032831:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186404.032874:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937916288:12345-0@lo:13: Request processed in 76us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186404.032896:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784186404.032936:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffede6680 x1870854937916288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186404.032946:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1784186404.032964:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937916288:0@lo:13: 00000100:00100000:3.0:1784186404.033712:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937916160:0@lo:400: 00000100:00100000:3.0:1784186404.033757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186404.033803:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937915776 00000100:00100000:3.0:1784186404.033808:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937915776 00000100:00100000:3.0:1784186404.033840:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784186404.033847:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+16:3308:x1870854937915776:12345-0@lo:400: 00000100:00100000:3.0:1784186404.033880:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+16:3308:x1870854937915776:12345-0@lo:400: Request processed in 34us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186404.033886:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784186404.033917:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937915904 00000100:00100000:3.0:1784186404.033920:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937915904 00000100:00100000:3.0:1784186404.033940:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937916032 00000100:00100000:3.0:1784186404.033943:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937916032 00000100:00100000:3.0:1784186404.033958:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784186404.033963:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937915904:12345-0@lo:400: 00000100:00100000:3.0:1784186404.033993:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937915904:12345-0@lo:400: Request processed in 29us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186404.033998:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784186404.034010:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784186404.034015:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937916032:12345-0@lo:400: 00000100:00100000:3.0:1784186404.034045:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937916032:12345-0@lo:400: Request processed in 30us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186404.034051:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1784186404.034070:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784186404.034074:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784186404.034183:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9fc9c59c00 x1870854937915904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186404.034196:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937915904:0@lo:400: 00000100:00100000:3.0:1784186404.034216:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937915776:0@lo:400: 00010000:00080000:3.0:1784186404.034264:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9fc9c58000 x1870854937916032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186404.034273:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937916032:0@lo:400: 00000100:00100000:1.0:1784186404.035248:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937916160 00000100:00100000:1.0:1784186404.035256:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937916160 00000100:00100000:1.0:1784186404.035305:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784186404.035322:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937916160:12345-0@lo:400: 00000100:00100000:1.0:1784186404.035380:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937916160:12345-0@lo:400: Request processed in 69us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186404.035387:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784186404.039174:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9fc9c58e00 x1870854937916160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186404.039194:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937916160:0@lo:400: 00010000:00010000:0.0:1784186404.861642:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186405.887239:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784186406.750979:0:7463:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784186406.750984:0:7463:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1784186406.751144:0:7463:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b9fc9c79000 00000020:01000004:1.0:1784186406.751161:0:7463:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784186406.751174:0:7463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1784186406.751201:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b9fc92e19c0) 00000020:00000080:1.0:1784186406.751218:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784186406.780161:0:7463:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1784186406.782979:0:7463:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784186406.818240:0:7463:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784186406.823941:0:7463:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784186406.823975:0:7463:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784186406.824030:0:7463:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784186406.824056:0:7463:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784186406.824579:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784186406.824593:0:7463:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784186406.824603:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x55bc3e8c99d18fc1 00000020:01000004:2.0:1784186406.824611:0:7463:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1784186406.824631:0:7463:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784186406.824634:0:7463:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784186406.824639:0:7463:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784186406.824657:0:7463:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1784186406.824661:0:7463:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784186406.840831:0:7463:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784186406.840886:0:7463:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.131@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1784186406.840891:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784186406.840893:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784186406.840894:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784186406.840895:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784186406.840897:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784186406.840898:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784186406.840900:0:7463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784186406.840901:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784186406.840902:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784186406.840904:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784186406.840905:0:7463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784186406.840908:0:7463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1784186406.840910:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784186406.840912:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784186406.840913:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784186406.840914:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784186406.840915:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784186406.840916:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784186406.840917:0:7463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784186406.840918:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784186406.840919:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784186406.840920:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784186406.840921:0:7463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784186406.840951:0:7463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784186406.840972:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937916416:0@lo:253: 00000100:00100000:3.0:1784186406.841046:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186406.841153:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5414000 going to sleep for 11 seconds 00000100:00100000:0.0:1784186406.841207:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937916416 00000100:00100000:0.0:1784186406.841215:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937916416 00000100:00100000:0.0:1784186406.841365:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784186406.841375:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:7463:x1870854937916416:12345-0@lo:253: 20000000:01000000:0.0:1784186406.841406:0:5774:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784186406.841410:0:5774:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1784186406.841415:0:5774:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1784186406.841419:0:5774:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1784186406.842468:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784186406.842687:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1784186406.842700:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1784186406.842741:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1784186406.842749:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1784186406.842774:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1784186406.842812:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1784186406.843153:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1784186406.843174:0:5774:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.131@tcp 20000000:01000000:0.0:1784186406.843176:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:0.0:1784186406.843225:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1784186406.843240:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784186406.843295:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1784186406.843303:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:0.0:1784186406.843330:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1784186406.843338:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1784186406.843361:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1784186406.843415:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1784186406.845240:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1784186406.845341:0:5774:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.131@tcp 20000000:01000000:1.0:1784186406.845344:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.131@tcp (null) (null) (null) 00000040:00080000:1.0:1784186406.845380:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1784186406.845387:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784186406.845411:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1784186406.845417:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.131@tcp (null) (null) 00000040:00080000:1.0:1784186406.845698:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1784186406.845710:0:5774:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784186406.845782:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1784186406.845814:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1784186406.845833:0:5774:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1784186406.845837:0:5774:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1784186406.845843:0:5774:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784186406.845845:0:5774:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784186406.845848:0:5774:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784186406.845862:0:5774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784186406.845865:0:5774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784186406.845905:0:5774:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1784186406.845908:0:5774:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784186406.846420:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1784186406.846828:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1784186406.846890:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1784186406.846949:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1784186406.846962:0:5774:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784186406.846965:0:5774:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784186406.847438:0:7466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1784186406.847601:0:7466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1784186406.847656:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1784186406.847931:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1784186406.847969:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1784186406.848023:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1784186406.848036:0:5774:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784186406.848038:0:5774:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784186406.848701:0:7467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1784186406.848759:0:7467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1784186406.848815:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1784186406.849130:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1784186406.849170:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1784186406.849218:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1784186406.849231:0:5774:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784186406.849233:0:5774:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784186406.850132:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1784186406.850232:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1784186406.850335:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1784186406.850849:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1784186406.850891:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1784186406.850946:0:5774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:1.0:1784186406.850966:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784186406.850985:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851003:0:5774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d18f19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f12 expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851011:0:5774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda504800/0x55bc3e8c99d18f43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f3c expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851018:0:5774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d18f6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f66 expref: 16 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851024:0:5774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fca860e00/0x55bc3e8c99d18f89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f82 expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851039:0:5774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d18fb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18fac expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851048:0:5774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851081:0:5774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d18fb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18fac expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851094:0:5774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d18fb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18fac expref: 16 pid: 5774 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.851108:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937916544:0@lo:104: 00000100:00100000:1.0:1784186406.851168:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784186406.851228:0:5774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fca860e00/0x55bc3e8c99d18f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18f82 expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851237:0:5774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fca860e00/0x55bc3e8c99d18f89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f82 expref: 16 pid: 5774 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.851245:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937916672:0@lo:104: 00010000:00010000:1.0:1784186406.851335:0:5774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d18f6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18f66 expref: 16 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851344:0:5774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d18f6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f66 expref: 16 pid: 5775 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.851353:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd541500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937916800:0@lo:104: 00010000:00010000:1.0:1784186406.851376:0:5774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda504800/0x55bc3e8c99d18f43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18f3c expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851388:0:5774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fda504800/0x55bc3e8c99d18f43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f3c expref: 16 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.851396:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd541f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937916928:0@lo:104: 00010000:00010000:1.0:1784186406.851418:0:5774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d18f19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18f12 expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.851426:0:5774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d18f19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f12 expref: 16 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.851433:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937917056:0@lo:104: 00000100:00100000:1.0:1784186406.851590:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808180 going to sleep for 11 seconds 00000100:00100000:3.0:1784186406.851675:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784186406.851694:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186406.851722:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186406.851730:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186406.851737:0:5766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186406.851749:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937916544 00000100:00100000:3.0:1784186406.851755:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937916544 00000100:00100000:3.0:1784186406.851788:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937916672 00000100:00100000:3.0:1784186406.851790:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937916672 00000100:00100000:3.0:1784186406.851800:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937916800 00000100:00100000:3.0:1784186406.851802:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937916800 00000100:00100000:3.0:1784186406.851810:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937916928 00000100:00100000:3.0:1784186406.851812:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937916928 00000100:00100000:3.0:1784186406.851821:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937917056 00000100:00100000:3.0:1784186406.851823:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937917056 00000100:00100000:3.0:1784186406.851835:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784186406.851843:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc925a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+7:5774:x1870854937916544:12345-0@lo:104: 00010000:00010000:3.0:1784186406.851857:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186406.851904:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784186406.851909:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc925a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+7:5774:x1870854937916544:12345-0@lo:104: Request processed in 68us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186406.851915:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784186406.851962:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784186406.851974:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+6:5774:x1870854937916672:12345-0@lo:104: 00010000:00010000:3.0:1784186406.851981:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186406.852006:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784186406.852009:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+6:5774:x1870854937916672:12345-0@lo:104: Request processed in 37us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186406.852014:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784186406.852025:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784186406.852029:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+5:5774:x1870854937916800:12345-0@lo:104: 00010000:00010000:3.0:1784186406.852034:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186406.852053:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784186406.852057:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+5:5774:x1870854937916800:12345-0@lo:104: Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186406.852062:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784186406.852073:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784186406.852076:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+4:5774:x1870854937916928:12345-0@lo:104: 00010000:00010000:3.0:1784186406.852082:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186406.852100:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784186406.852104:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+4:5774:x1870854937916928:12345-0@lo:104: Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186406.852109:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784186406.852120:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784186406.852125:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:5774:x1870854937917056:12345-0@lo:104: 00010000:00010000:3.0:1784186406.852138:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186406.852164:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1784186406.852169:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:5774:x1870854937917056:12345-0@lo:104: Request processed in 44us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186406.852174:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1784186406.852363:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784186406.852371:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852379:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129400 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186406.852383:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852392:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186406.852400:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186406.852411:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186406.852457:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852463:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186406.852490:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852497:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129400/0x55bc3e8c99d18fac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18fb3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852513:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784186406.852516:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852522:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128400 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186406.852569:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852578:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186406.852585:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186406.852590:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186406.852604:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852611:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186406.852631:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852638:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128400/0x55bc3e8c99d18f82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f89 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852648:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784186406.852651:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852657:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fca860000 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186406.852660:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852667:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186406.852673:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186406.852678:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186406.852689:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852695:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186406.852699:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852706:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fca860000/0x55bc3e8c99d18f66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f6d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852716:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784186406.852723:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852729:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27edc00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186406.852732:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852739:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186406.852745:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186406.852750:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186406.852761:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852766:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186406.852771:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852777:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc27edc00/0x55bc3e8c99d18f3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f43 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852785:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186406.852788:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852794:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128e00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186406.852796:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852811:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186406.852817:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186406.852823:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186406.852834:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852839:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186406.852843:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852849:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18f12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f19 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.852860:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186406.852862:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186406.852864:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186406.852870:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186406.852890:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937917568:0@lo:103: 00000100:00100000:0.0:1784186406.852925:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186406.852954:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784186406.852959:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937917184:0@lo:103: 00000100:00100000:0.0:1784186406.852977:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186406.852993:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937917696:0@lo:103: 00000100:00100000:0.0:1784186406.853010:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186406.853036:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937917312:0@lo:103: 00000100:00100000:0.0:1784186406.853056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186406.853068:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784186406.853073:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937917440:0@lo:103: 00000100:00100000:0.0:1784186406.853089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186406.853116:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937917568 00000100:00100000:0.0:1784186406.853121:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937917568 00010000:00010000:0.0:1784186406.853142:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda504800/0x55bc3e8c99d18f43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f3c expref: 17 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186406.853158:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937917184 00000100:00100000:0.0:1784186406.853161:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937917184 00010000:00010000:0.0:1784186406.853170:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d18fb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18fac expref: 18 pid: 5774 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186406.853179:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937917696 00000100:00100000:0.0:1784186406.853182:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937917696 00010000:00010000:0.0:1784186406.853204:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d18f19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f12 expref: 19 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186406.853215:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937917312 00000100:00100000:0.0:1784186406.853218:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937917312 00010000:00010000:0.0:1784186406.853226:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fca860e00/0x55bc3e8c99d18f89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f82 expref: 20 pid: 5774 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186406.853235:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937917440 00000100:00100000:0.0:1784186406.853237:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937917440 00010000:00010000:0.0:1784186406.853245:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d18f6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f66 expref: 21 pid: 5775 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186406.853257:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784186406.853274:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+21:3308:x1870854937917568:12345-0@lo:103: 00010000:00010000:0.0:1784186406.853292:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186406.853297:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda504800/0x55bc3e8c99d18f43 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f3c expref: 21 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853306:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda504800/0x55bc3e8c99d18f43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f3c expref: 21 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853323:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186406.853352:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+21:3308:x1870854937917568:12345-0@lo:103: Request processed in 89us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186406.853359:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784186406.853373:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784186406.853378:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+20:3308:x1870854937917184:12345-0@lo:103: 00010000:00010000:0.0:1784186406.853385:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186406.853389:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d18fb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18fac expref: 20 pid: 5774 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853398:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d18fb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18fac expref: 20 pid: 5774 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853408:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186406.853430:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+20:3308:x1870854937917184:12345-0@lo:103: Request processed in 51us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186406.853436:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784186406.853471:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784186406.853477:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937917696:12345-0@lo:103: 00010000:00010000:0.0:1784186406.853484:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186406.853489:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d18f19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f12 expref: 19 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853503:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d18f19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f12 expref: 19 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853513:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186406.853536:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937917696:12345-0@lo:103: Request processed in 59us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186406.853542:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784186406.853554:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784186406.853559:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:3306:x1870854937917312:12345-0@lo:103: 00010000:00010000:0.0:1784186406.853566:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186406.853570:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fca860e00/0x55bc3e8c99d18f89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f82 expref: 18 pid: 5774 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853578:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fca860e00/0x55bc3e8c99d18f89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f82 expref: 18 pid: 5774 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853587:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186406.853608:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:3306:x1870854937917312:12345-0@lo:103: Request processed in 50us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186406.853614:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784186406.853623:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784186406.853628:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:3306:x1870854937917440:12345-0@lo:103: 00010000:00010000:0.0:1784186406.853635:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186406.853639:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d18f6d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f66 expref: 17 pid: 5775 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853647:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d18f6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f66 expref: 17 pid: 5775 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853665:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853674:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853688:0:5767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853695:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853701:0:5767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853707:0:5767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853713:0:5767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec800 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186406.853718:0:5767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853724:0:5767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853732:0:5767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.853740:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186406.853763:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:3306:x1870854937917440:12345-0@lo:103: Request processed in 134us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186406.853778:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784186406.853813:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937917440:0@lo:103: 00000100:00100000:0.0:1784186406.853821:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937917312:0@lo:103: 00000100:00100000:0.0:1784186406.853842:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937917184:0@lo:103: 00000100:00100000:0.0:1784186406.853849:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937917696:0@lo:103: 00000100:00100000:0.0:1784186406.853855:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937917568:0@lo:103: 00010000:00010000:1.0:1784186406.854342:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d18fb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18fac expref: 16 pid: 5774 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.854357:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937916544:0@lo:104: 00010000:00010000:1.0:1784186406.854370:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fca860e00/0x55bc3e8c99d18f89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18f82 expref: 15 pid: 5774 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.854377:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937916672:0@lo:104: 00010000:00010000:1.0:1784186406.854384:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d18f6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18f66 expref: 14 pid: 5775 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.854391:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd541500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937916800:0@lo:104: 00010000:00010000:1.0:1784186406.854398:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda504800/0x55bc3e8c99d18f43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18f3c expref: 13 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.854416:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd541f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937916928:0@lo:104: 00010000:00010000:1.0:1784186406.854426:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d18f19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18f12 expref: 12 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.854432:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5774:1870854937917056:0@lo:104: 00010000:00010000:1.0:1784186406.854489:0:5774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.854499:0:5774:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.854505:0:5774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.854512:0:5774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d18fc8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784186406.854526:0:5774:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1784186406.916094:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186406.920625:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+11:7463:x1870854937916416:12345-0@lo:253: Request processed in 79240us (79567us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186406.920642:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784186406.920812:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937916416:0@lo:253: 10000000:01000000:2.0:1784186406.920828:0:7463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784186406.920831:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784186406.920833:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784186406.920834:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186406.920835:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1784186406.920836:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186406.920837:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186406.920852:0:7463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784186406.920854:0:7463:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784186406.920856:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186406.920857:0:7463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784186406.920882:0:7463:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b9fc9c79000 from lustre-OST0001 10000000:01000000:2.0:1784186406.920906:0:7463:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1784186406.920909:0:7463:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784186406.920916:0:7463:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b9fc7763380 local copy 10000000:01000000:2.0:1784186406.920920:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784186406.920956:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.920968:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.920979:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186406.920998:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937917824:0@lo:101: 00000100:00100000:2.0:1784186406.921035:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186406.921086:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe56e3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784186406.921506:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937917824 00000100:00100000:0.0:1784186406.921515:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937917824 00000100:00100000:0.0:1784186406.921566:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784186406.921575:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+11:7463:x1870854937917824:12345-0@lo:101: 00010000:00010000:0.0:1784186406.921587:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186406.921601:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9128e00/0x55bc3e8c99d18fd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18fcf expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.921625:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9128e00/0x55bc3e8c99d18fd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18fcf expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.921635:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9128e00/0x55bc3e8c99d18fd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18fcf expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.921643:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128e00, rc 0) 00000100:00100000:0.0:1784186406.921684:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937917824:12345-0@lo:101: Request processed in 110us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186406.921689:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784186406.921811:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937917824:0@lo:101: 00010000:00010000:2.0:1784186406.921825:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.921832:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186406.921929:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937917952:0@lo:501: 00000100:00100000:2.0:1784186406.921958:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186406.921988:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe56e3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784186406.922159:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937917952 00000100:00100000:0.0:1784186406.922163:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937917952 00000100:00100000:0.0:1784186406.922199:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784186406.922206:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937917952:12345-0@lo:501: 00000100:00100000:0.0:1784186406.922405:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937917952:12345-0@lo:501: Request processed in 199us (445us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784186406.922412:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784186406.922581:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937917952:0@lo:501: 10000000:01000000:2.0:1784186406.922595:0:7463:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784186406.922620:0:7463:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784186406.922626:0:7463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.922634:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.922641:0:7463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.922662:0:7463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784186406.922684:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b9fc9c79000 10000000:01000000:2.0:1784186406.922689:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784186406.922694:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784186406.922697:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784186406.922701:0:7463:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1784186406.922703:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784186406.922721:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.922729:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.922738:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186406.922750:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918080:0@lo:101: 00000100:00100000:2.0:1784186406.922775:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186406.922806:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe56e3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784186406.922821:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937918080 00000100:00100000:2.0:1784186406.922825:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937918080 00000100:00100000:2.0:1784186406.922848:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784186406.922854:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937918080:12345-0@lo:101: 00010000:00010000:2.0:1784186406.922863:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186406.922873:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d18fe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18fdd expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.922889:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d18fe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18fdd expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.922898:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d18fe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18fdd expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.922904:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505a00, rc 0) 00000100:00100000:2.0:1784186406.922928:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937918080:12345-0@lo:101: Request processed in 75us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186406.922933:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784186406.922964:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918080:0@lo:101: 00010000:00010000:2.0:1784186406.922973:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.922980:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186406.923022:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918208:0@lo:501: 00000100:00100000:2.0:1784186406.923055:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186406.923066:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe56e3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784186406.923082:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937918208 00000100:00100000:2.0:1784186406.923086:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937918208 00000100:00100000:2.0:1784186406.923107:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784186406.923112:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937918208:12345-0@lo:501: 00010000:00010000:0.0:1784186406.923353:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186406.923360:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.923368:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504600 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186406.923372:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.923381:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186406.923388:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186406.923394:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186406.923413:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.923418:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186406.923433:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.923481:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fda504600/0x55bc3e8c99d18fcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x55bc3e8c99d18fd6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.923494:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186406.923495:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186406.923497:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186406.923504:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186406.923513:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937918336:0@lo:103: 00000100:00100000:0.0:1784186406.923538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186406.923572:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937918336 00000100:00100000:0.0:1784186406.923576:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937918336 00000100:00100000:0.0:1784186406.923605:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784186406.923611:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:3307:x1870854937918336:12345-0@lo:103: 00010000:00010000:0.0:1784186406.923620:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186406.923631:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9128e00/0x55bc3e8c99d18fd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d18fcf expref: 14 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.923641:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186406.923663:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:3307:x1870854937918336:12345-0@lo:103: Request processed in 53us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186406.923670:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784186406.923692:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937918336:0@lo:103: 00000100:00100000:2.0:1784186406.923811:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937918208:12345-0@lo:501: Request processed in 697us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186406.923817:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784186406.923852:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918208:0@lo:501: 00000100:00100000:2.0:1784186406.923879:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918464:0@lo:503: 00000100:00100000:2.0:1784186406.923916:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186406.924004:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe56e3900 going to sleep for 11 seconds 00000100:00100000:0.0:1784186406.924129:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937918464 00000100:00100000:0.0:1784186406.924134:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937918464 00000100:00100000:0.0:1784186406.924164:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784186406.924171:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937918464:12345-0@lo:503: 00000100:00100000:0.0:1784186406.924594:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937918464:12345-0@lo:503: Request processed in 422us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186406.924602:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784186406.924788:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918464:0@lo:503: 00000040:00080000:3.0:1784186406.925064:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784186406.925119:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918592:0@lo:502: 00000100:00100000:3.0:1784186406.925159:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186406.925201:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5414600 going to sleep for 11 seconds 00000100:00100000:2.0:1784186406.925506:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937918592 00000100:00100000:2.0:1784186406.925512:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937918592 00000100:00100000:2.0:1784186406.925546:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784186406.925554:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937918592:12345-0@lo:502: 00000100:00100000:2.0:1784186406.925732:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937918592:12345-0@lo:502: Request processed in 178us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186406.925740:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784186406.925937:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918592:0@lo:502: 00000040:00080000:3.0:1784186406.926210:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784186406.926258:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1784186406.926303:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1784186406.926343:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1784186406.926372:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1784186406.926401:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1784186406.926427:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918720:0@lo:502: 00000100:00100000:3.0:1784186406.926526:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186406.926549:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5414600 going to sleep for 11 seconds 00000100:00100000:1.0:1784186406.926801:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937918720 00000100:00100000:1.0:1784186406.926807:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937918720 00000100:00100000:1.0:1784186406.926850:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784186406.926857:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937918720:12345-0@lo:502: 00000100:00100000:1.0:1784186406.927001:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937918720:12345-0@lo:502: Request processed in 144us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186406.927008:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784186406.927259:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918720:0@lo:502: 00000040:00080000:3.0:1784186406.927366:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1784186406.927377:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1784186406.927946:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784186406.927954:0:7470:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1784186406.927966:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186406.927968:0:7470:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784186406.927972:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784186406.927985:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b9fd1853380) 00000020:00000080:3.0:1784186406.928008:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784186406.928012:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784186406.928081:0:7470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b9fc9c79000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784186406.928088:0:7470:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784186406.928094:0:7470:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x55bc3e8c99d18ff2 00010000:00010000:3.0:1784186406.931616:0:7470:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1784186406.931898:0:7470:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1784186406.938758:0:7470:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1784186406.939043:0:7470:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1784186406.945966:0:7470:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1784186406.946431:0:7470:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1784186406.949650:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1784186406.949661:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186406.949667:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186406.949669:0:7470:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1784186406.949673:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784186406.949677:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186406.949678:0:7470:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784186406.949681:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784186406.949683:0:7470:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784186406.949732:0:7470:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186406.949735:0:7470:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186406.949737:0:7470:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784186406.949740:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1784186406.949930:0:7463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1784186406.949960:0:7463:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784186406.949987:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.949998:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186406.950005:0:7463:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc9c79000 from 1 10000000:01000000:0.0:1784186406.950008:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784186406.950041:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.950050:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186406.950060:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186406.950084:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918848:0@lo:101: 00000100:00100000:0.0:1784186406.950151:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186406.950211:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc3055e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784186406.951195:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937918848 00000100:00100000:3.0:1784186406.951206:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937918848 00000100:00100000:3.0:1784186406.951252:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784186406.951271:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+12:7463:x1870854937918848:12345-0@lo:101: 00010000:00010000:3.0:1784186406.951641:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186406.951657:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d19000 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d18ff9 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186406.951684:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d19000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d18ff9 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186406.951695:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d19000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18ff9 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186406.951704:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17800, rc 0) 00000100:00100000:3.0:1784186406.951770:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937918848:12345-0@lo:101: Request processed in 510us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186406.951778:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784186406.951982:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918848:0@lo:101: 00010000:00010000:2.0:1784186406.952001:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.952010:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186406.952116:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918976:0@lo:501: 00000100:00100000:2.0:1784186406.952151:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186406.952200:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc4d89240 going to sleep for 11 seconds 00000100:00100000:2.0:1784186406.952217:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937918976 00000100:00100000:2.0:1784186406.952221:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937918976 00000100:00100000:2.0:1784186406.952248:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784186406.952255:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937918976:12345-0@lo:501: 00000100:00100000:2.0:1784186406.952704:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937918976:12345-0@lo:501: Request processed in 447us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186406.952711:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784186406.952797:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937918976:0@lo:501: 00000100:00100000:3.0:1784186406.952830:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919104:0@lo:503: 00000100:00100000:3.0:1784186406.952870:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186406.952899:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe54140c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186406.954960:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937919104 00000100:00100000:0.0:1784186406.954973:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937919104 00000100:00100000:0.0:1784186406.955018:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784186406.955027:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937919104:12345-0@lo:503: 00000100:00100000:0.0:1784186406.958519:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937919104:12345-0@lo:503: Request processed in 3484us (5639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186406.958534:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784186406.958821:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919104:0@lo:503: 00000040:00080000:3.0:1784186406.959139:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784186406.960504:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919232:0@lo:502: 00000100:00100000:3.0:1784186406.960594:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186406.960831:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe54140c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186406.963009:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937919232 00000100:00100000:2.0:1784186406.963023:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937919232 00000100:00100000:2.0:1784186406.963074:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784186406.963083:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937919232:12345-0@lo:502: 00000100:00100000:2.0:1784186406.964426:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937919232:12345-0@lo:502: Request processed in 1338us (3825us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186406.964437:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784186406.964797:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919232:0@lo:502: 00000040:00080000:0.0:1784186406.965085:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1784186406.965172:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1784186406.965220:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919360:0@lo:502: 00000100:00100000:0.0:1784186406.965340:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186406.965385:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd18c4240 going to sleep for 11 seconds 00000100:00100000:1.0:1784186406.965500:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937919360 00000100:00100000:1.0:1784186406.965506:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937919360 00000100:00100000:1.0:1784186406.965542:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784186406.965557:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937919360:12345-0@lo:502: 00000100:00100000:1.0:1784186406.965716:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937919360:12345-0@lo:502: Request processed in 159us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186406.965723:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784186406.966092:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919360:0@lo:502: 00000040:00080000:0.0:1784186406.966208:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784186406.966219:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1784186406.968753:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186406.968767:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186406.968769:0:7474:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784186406.968775:0:7474:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9fc9c79000 00000020:00000080:2.0:1784186406.968778:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784186406.968801:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186406.968804:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186406.968805:0:7474:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784186406.968808:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1784186406.968969:0:7463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1784186406.968999:0:7463:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784186406.969025:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.969043:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186406.969091:0:7463:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784186406.969094:0:7463:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b9fc9c79000 10000000:01000000:1.0:1784186406.969098:0:7463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b9fc9c79000 10000000:01000000:1.0:1784186406.969102:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784186406.969108:0:7463:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9fc9c79000 from 1 10000000:01000000:1.0:1784186406.969110:0:7463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784186406.969146:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.969154:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.969165:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.969198:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919488:0@lo:101: 00000100:00100000:1.0:1784186406.969259:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186406.969378:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186406.969644:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937919488 00000100:00100000:2.0:1784186406.969650:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937919488 00000100:00100000:2.0:1784186406.969690:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784186406.969699:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937919488:12345-0@lo:101: 00010000:00010000:2.0:1784186406.969713:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186406.969730:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda505400/0x55bc3e8c99d1900e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d19007 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.969753:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda505400/0x55bc3e8c99d1900e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d19007 expref: 14 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.969765:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda505400/0x55bc3e8c99d1900e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19007 expref: 14 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.969773:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505400, rc 0) 00000100:00100000:2.0:1784186406.969813:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7463:x1870854937919488:12345-0@lo:101: Request processed in 114us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186406.969820:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784186406.970409:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919488:0@lo:101: 00010000:00010000:1.0:1784186406.970425:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186406.970435:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186406.970679:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919616:0@lo:501: 00000100:00100000:1.0:1784186406.970717:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186406.970746:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186406.972067:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937919616 00000100:00100000:2.0:1784186406.972078:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937919616 00000100:00100000:2.0:1784186406.972131:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784186406.972141:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7463:x1870854937919616:12345-0@lo:501: 00000100:00100000:1.0:1784186406.974658:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919616:0@lo:501: 00000100:00100000:1.0:1784186406.974714:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919744:0@lo:503: 00000100:00100000:1.0:1784186406.976172:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186406.976253:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186406.976368:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7463:x1870854937919616:12345-0@lo:501: Request processed in 4226us (5648us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186406.976381:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784186406.976421:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937919744 00000100:00100000:2.0:1784186406.976428:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937919744 00000100:00100000:3.0:1784186406.977180:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784186406.977203:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7463:x1870854937919744:12345-0@lo:503: 00000100:00100000:1.0:1784186406.977676:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919744:0@lo:503: 00000040:00080000:1.0:1784186406.977994:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784186406.978070:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919872:0@lo:502: 00000100:00100000:1.0:1784186406.978121:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186406.978147:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784186406.978213:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7463:x1870854937919744:12345-0@lo:503: Request processed in 239us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186406.978229:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784186406.978276:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937919872 00000100:00100000:3.0:1784186406.978282:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937919872 00000100:00100000:3.0:1784186406.978308:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784186406.978315:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7463:x1870854937919872:12345-0@lo:502: 00000100:00100000:3.0:1784186406.978742:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7463:x1870854937919872:12345-0@lo:502: Request processed in 427us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186406.978749:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784186406.978829:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937919872:0@lo:502: 00000040:00080000:1.0:1784186406.979087:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784186406.979137:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784186406.979172:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784186406.979237:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784186406.979290:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784186406.979343:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784186406.979389:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784186406.979424:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784186406.979693:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784186406.979734:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784186406.979770:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784186406.979819:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784186406.979854:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784186406.979886:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784186406.979951:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784186406.979987:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784186406.980020:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784186406.980068:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784186406.980105:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784186406.980141:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784186406.980856:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784186406.980911:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784186406.980942:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784186406.980993:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784186406.981030:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1784186406.981063:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1784186406.981105:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1784186406.981136:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1784186406.981170:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1784186406.981233:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1784186406.981842:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1784186406.981874:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1784186406.981901:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1784186406.981945:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1784186406.981980:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1784186406.982043:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1784186406.982082:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1784186406.982132:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937920000:0@lo:502: 00000100:00100000:1.0:1784186406.982232:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186406.982285:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186406.982366:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937920000 00000100:00100000:2.0:1784186406.982374:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937920000 00000100:00100000:2.0:1784186406.982408:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784186406.982416:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7463:x1870854937920000:12345-0@lo:502: 00000100:00100000:2.0:1784186406.982672:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7463:x1870854937920000:12345-0@lo:502: Request processed in 255us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186406.982680:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784186406.983059:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937920000:0@lo:502: 00000040:00080000:1.0:1784186406.983147:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1784186406.983158:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1784186406.984062:0:7475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784186406.984087:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9b9ec6818000) 00000020:00000080:1.0:1784186406.984108:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1784186406.984286:0:7475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b9fc9c79000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784186406.984290:0:7475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b9fc9c79000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784186406.984294:0:7475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9fc9c79000 3 00010000:00080000:1.0:1784186406.984324:0:7475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b9ec6813800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.131@tcp at head 00010000:00010000:1.0:1784186406.985962:0:7475:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1784186406.986073:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1784186406.986111:0:7475:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784186406.986122:0:7475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x55bc3e8c99d1901c 00000100:00080000:1.0:1784186406.986132:0:7475:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784186406.986137:0:7475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b9ec6813800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1784186406.986175:0:7475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffd542a00 x1870854937920128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784186406.986280:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1870854937920128:0@lo:38: 00000100:00100000:0.0:1784186406.986347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186406.988523:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937920128 00000100:00100000:3.0:1784186406.988539:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937920128 00000100:00100000:3.0:1784186406.988591:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784186406.988599:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1870854937920128:12345-0@lo:38: 00010000:00080000:3.0:1784186406.988630:0:5783:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:3.0:1784186406.988670:0:5783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x55bc3e8c99d19023 00000004:00100000:3.0:1784186406.988688:0:5783:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784186406.988726:0:5783:0:(import.c:65:import_set_state_nolock()) ffff9b9ec5bdf800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1784186406.989064:0:7475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1784186406.989324:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1784186406.991735:0:7477:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9b9ffd541f80 x1870854937920256/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186406.991749:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808840 going to sleep for 0 seconds 00000100:00100000:2.0:1784186406.991968:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784186406.991981:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937920384:0@lo:400: 00000100:00100000:2.0:1784186406.992050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186406.992094:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937920512:0@lo:400: 00000100:00100000:2.0:1784186406.992118:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186406.992132:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784186406.992137:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937920640:0@lo:400: 00000100:00100000:2.0:1784186406.992162:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186406.992203:0:5784:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1784186406.992212:0:5784:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1784186406.992234:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937920640 00000100:00100000:2.0:1784186406.992240:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937920640 00000100:00100000:2.0:1784186406.992298:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784186406.992307:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937920640:12345-0@lo:400: 00000100:00100000:2.0:1784186406.992362:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937920640:12345-0@lo:400: Request processed in 56us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186406.992369:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1784186406.992394:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784186406.992423:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffede7800 x1870854937920640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186406.992435:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937920640:0@lo:400: 00000020:01000000:2.0:1784186406.992494:0:7463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1784186406.992526:0:7463:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784186406.992540:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186406.992549:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784186406.992626:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784186406.992629:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784186406.992630:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186406.992631:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186406.992632:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186406.992633:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186406.992635:0:7463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784186406.992636:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784186406.992638:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784186406.992639:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186406.992640:0:7463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784186406.992644:0:7463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1784186406.992646:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784186406.992647:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784186406.992648:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186406.992649:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186406.992650:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186406.992651:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186406.992652:0:7463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784186406.992654:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784186406.992655:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784186406.992656:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186406.992657:0:7463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784186406.992671:0:7463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784186406.992681:0:7463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937920768:0@lo:253: 00000100:00100000:2.0:1784186406.992727:0:7463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186406.992750:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937920768 00000100:00100000:2.0:1784186406.992754:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937920768 00000100:00100000:2.0:1784186406.992779:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784186406.992786:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7463:x1870854937920768:12345-0@lo:253: 20000000:01000000:2.0:1784186406.992806:0:5774:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784186406.992824:0:5774:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784186406.994336:0:7463:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58840 going to sleep for 11 seconds 00000100:00100000:3.0:1784186406.997330:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870854937920128:12345-0@lo:38: Request processed in 8720us (10972us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186406.997343:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784186406.997388:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937920384 00000100:00100000:3.0:1784186406.997396:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937920384 00000100:00100000:3.0:1784186406.997425:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937920512 00000100:00100000:3.0:1784186406.997428:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937920512 00000100:00100000:3.0:1784186406.997517:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784186406.997526:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937920384:12345-0@lo:400: 00000100:00100000:3.0:1784186406.997601:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937920384:12345-0@lo:400: Request processed in 76us (5551us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186406.997616:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784186406.997630:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784186406.997635:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937920512:12345-0@lo:400: 00000100:00100000:3.0:1784186406.997671:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937920512:12345-0@lo:400: Request processed in 36us (5552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186406.997676:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1784186407.000308:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffede4700 x1870854937920384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186407.000336:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937920384:0@lo:400: 00010000:00080000:2.0:1784186407.000375:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffede5f80 x1870854937920512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186407.000385:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937920512:0@lo:400: 00000100:00080000:1.0:1784186407.001425:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784186407.004748:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffd542a00 x1870854937920128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784186416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186407.004764:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784186407.004774:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1784186407.004783:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784186407.004789:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784186407.004793:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9ec6813800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1784186407.004800:0:3305:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e0105d4a): req@ffff9b9ffd541f80 x1870854937920256/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186407.004820:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1870854937920128:0@lo:38: 00000100:00100000:0.0:1784186407.007462:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186407.007533:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808840 going to sleep for 11 seconds 00000100:00100000:2.0:1784186407.009337:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937920256 00000100:00100000:2.0:1784186407.009352:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937920256 00000100:00100000:2.0:1784186407.009433:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784186407.009459:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7477:x1870854937920256:12345-0@lo:901: 00000100:00100000:2.0:1784186407.009866:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7477:x1870854937920256:12345-0@lo:901: Request processed in 423us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186407.009874:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784186407.009928:0:7477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffd541f80 x1870854937920256/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784186422 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186407.009944:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd541f80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7477:1870854937920256:0@lo:901: 00000100:00080000:0.0:1784186407.010746:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1784186407.042401:0:5774:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784186407.042486:0:5774:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1784186407.046556:0:5798:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784186407.046567:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784186407.046591:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186407.046610:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18f7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f74 expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186407.046620:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186407.046660:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18f7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18f74 expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186407.046674:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18f7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f74 expref: 14 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186407.046687:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5798:1870854937920896:0@lo:104: 00000100:00100000:3.0:1784186407.046746:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186407.046795:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5414180 going to sleep for 11 seconds 00000100:00100000:3.0:1784186407.046814:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937920896 00000100:00100000:3.0:1784186407.046821:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937920896 00000100:00100000:3.0:1784186407.046862:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784186407.046887:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:5798:x1870854937920896:12345-0@lo:104: 00010000:00010000:3.0:1784186407.046899:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186407.046949:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784186407.046955:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:5798:x1870854937920896:12345-0@lo:104: Request processed in 70us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186407.046962:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784186407.046997:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5798:1870854937920896:0@lo:104: 00010000:00010000:3.0:1784186407.047018:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047141:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186407.047150:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047157:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128a00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186407.047161:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047169:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186407.047175:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186407.047191:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186407.047224:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047231:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186407.047250:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047257:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d18f74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f7b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047282:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186407.047283:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186407.047285:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186407.047296:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937921024:0@lo:103: 00000100:00100000:0.0:1784186407.047336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186407.047375:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937921024 00000100:00100000:0.0:1784186407.047378:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937921024 00010000:00010000:0.0:1784186407.047395:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18f7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f74 expref: 15 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186407.047414:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784186407.047420:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe55b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:3306:x1870854937921024:12345-0@lo:103: 00010000:00010000:0.0:1784186407.047429:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186407.047434:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18f7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f74 expref: 15 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047477:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18f7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f74 expref: 15 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047490:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fca861e00/0x55bc3e8c99d18f7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18f74 expref: 15 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047502:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047510:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784186407.047523:0:5768:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002844353s 00010000:00010000:0.0:1784186407.047528:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047536:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047554:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047562:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047567:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186407.047570:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047578:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047591:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047600:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186407.047625:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe55b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+14:3306:x1870854937921024:12345-0@lo:103: Request processed in 205us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186407.047631:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784186407.047674:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937921024:0@lo:103: 00010000:00010000:0.0:1784186407.047709:0:5798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047717:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186407.047723:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf16200/0x55bc3e8c99d1902a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186407.063794:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:7463:x1870854937920768:12345-0@lo:253: Request processed in 70997us (71055us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186407.063811:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784186407.063902:0:7463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fab6759c-e30b-4013-88b9-0b4d132afa93:7463:1870854937920768:0@lo:253: 10000000:01000000:0.0:1784186407.063919:0:7463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784186407.063922:0:7463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784186407.063924:0:7463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784186407.063925:0:7463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784186407.063926:0:7463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784186407.063928:0:7463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784186407.063929:0:7463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784186407.063930:0:7463:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784186407.063931:0:7463:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784186407.063933:0:7463:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784186407.063935:0:7463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784186407.063936:0:7463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784186407.063951:0:7463:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784186407.082029:0:7463:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186407.082236:0:7463:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784186407.082581:0:7463:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186407.082749:0:7463:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784186407.082962:0:7463:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1784186407.083170:0:7463:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784186407.089366:0:7463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1784186407.342407:0:7463:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1784186407.342415:0:7463:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1784186407.342537:0:7463:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784186407.342599:0:7463:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784186407.342619:0:7463:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1784186407.342646:0:7463:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1784186407.935188:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186408.957614:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186409.151974:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937921152:0@lo:13: 00000100:00100000:2.0:1784186409.152055:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186409.152213:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937921152 00000100:00100000:0.0:1784186409.152221:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937921152 00000100:00100000:0.0:1784186409.152287:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784186409.152298:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937921152:12345-0@lo:13: 00002000:00000024:0.0:1784186409.152334:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186409.152388:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937921152:12345-0@lo:13: Request processed in 93us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186409.152395:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784186409.152433:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffd9ddc00 x1870854937921152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186409.152472:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937921152:0@lo:13: 00000100:00080000:2.0:1784186409.152574:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784186409.981611:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186411.005577:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186412.029626:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186412.222013:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937921408:0@lo:400: 00000100:00100000:1.0:1784186412.222094:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186412.222185:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784186412.222192:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937921280:0@lo:400: 00000100:00100000:1.0:1784186412.222221:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186412.222246:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937921792:0@lo:400: 00000100:00100000:1.0:1784186412.222272:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186412.222303:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937921408 00000100:00100000:1.0:1784186412.222310:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937921408 00000100:00100000:1.0:1784186412.222351:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937921792 00000100:00100000:1.0:1784186412.222356:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937921792 00000100:00100000:1.0:1784186412.222385:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784186412.222393:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937921408:12345-0@lo:400: 00000100:00100000:1.0:1784186412.222438:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937921408:12345-0@lo:400: Request processed in 46us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186412.222481:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784186412.222501:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784186412.222508:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937921792:12345-0@lo:400: 00000100:00100000:1.0:1784186412.222536:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937921792:12345-0@lo:400: Request processed in 29us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186412.222541:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784186412.222559:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937921280 00000100:00100000:1.0:1784186412.222562:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937921280 00000100:00100000:1.0:1784186412.222583:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784186412.222589:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+13:3309:x1870854937921280:12345-0@lo:400: 00000100:00100000:1.0:1784186412.222613:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+13:3309:x1870854937921280:12345-0@lo:400: Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186412.222619:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1784186412.222660:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186412.222698:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937921280:0@lo:400: 00010000:00080000:1.0:1784186412.222712:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c58e00 x1870854937921792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186412.222724:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937921792:0@lo:400: 00010000:00080000:1.0:1784186412.222734:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c5b480 x1870854937921408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186412.222743:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937921408:0@lo:400: 00000100:00100000:3.0:1784186412.223609:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937921536:0@lo:400: 00000100:00100000:3.0:1784186412.223658:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186412.223688:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186412.223696:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937921664:0@lo:400: 00000100:00100000:3.0:1784186412.223722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186412.223849:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937921664 00000100:00100000:2.0:1784186412.223856:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937921664 00000100:00100000:2.0:1784186412.223912:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784186412.223921:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937921664:12345-0@lo:400: 00000100:00100000:2.0:1784186412.223967:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937921664:12345-0@lo:400: Request processed in 48us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186412.223974:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784186412.224010:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c5a680 x1870854937921664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186412.224022:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937921664:0@lo:400: 00000100:00080000:3.0:1784186412.224167:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784186412.224710:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937921536 00000100:00100000:1.0:1784186412.224715:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937921536 00000100:00100000:1.0:1784186412.224759:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784186412.224766:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937921536:12345-0@lo:400: 00000100:00100000:1.0:1784186412.224807:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937921536:12345-0@lo:400: Request processed in 42us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186412.224813:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1784186412.224916:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784186412.225571:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c59180 x1870854937921536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186412.225586:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937921536:0@lo:400: 00010000:00010000:0.0:1784186413.053541:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186414.079145:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186414.277023:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784186414.277049:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937921920:0@lo:13: 00000100:00100000:2.0:1784186414.277125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186414.277184:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937921920 00000100:00100000:2.0:1784186414.277192:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937921920 00000100:00100000:2.0:1784186414.277247:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784186414.277255:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937921920:12345-0@lo:13: 00002000:00000024:2.0:1784186414.277285:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186414.277327:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937921920:12345-0@lo:13: Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186414.277346:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1784186414.277367:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784186414.277395:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffede4700 x1870854937921920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186414.277413:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937921920:0@lo:13: 00000001:02000400:2.0:1784186414.486227:0:7819:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784186415.101950:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784186415.293555:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784186415.293562:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9ffef01800 from 30 10000000:01000000:3.0:1784186415.293574:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784186415.293625:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.293637:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.293649:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186415.293673:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922048:0@lo:101: 00000100:00100000:3.0:1784186415.293736:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.293782:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65780 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.294087:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937922048 00000100:00100000:2.0:1784186415.294107:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937922048 00000100:00100000:2.0:1784186415.294340:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784186415.294352:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937922048:12345-0@lo:101: 00010000:00010000:2.0:1784186415.294367:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186415.294381:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda504400/0x55bc3e8c99d19038 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d19031 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.294405:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda504400/0x55bc3e8c99d19038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d19031 expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.294416:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda504400/0x55bc3e8c99d19038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19031 expref: 14 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.294425:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504400, rc 0) 00000100:00100000:2.0:1784186415.294496:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937922048:12345-0@lo:101: Request processed in 146us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.294504:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784186415.295351:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922048:0@lo:101: 00010000:00010000:3.0:1784186415.295374:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.295384:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186415.295476:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922176:0@lo:501: 00000100:00100000:3.0:1784186415.295518:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.295550:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65780 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.295634:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937922176 00000100:00100000:2.0:1784186415.295640:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937922176 00000100:00100000:2.0:1784186415.295678:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784186415.295695:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937922176:12345-0@lo:501: 00000100:00100000:2.0:1784186415.296029:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937922176:12345-0@lo:501: Request processed in 335us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.296038:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784186415.296344:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922176:0@lo:501: 00000100:00100000:3.0:1784186415.296380:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922304:0@lo:503: 00000100:00100000:3.0:1784186415.296423:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.296491:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65780 going to sleep for 11 seconds 00000100:00100000:3.0:1784186415.296505:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937922304 00000100:00100000:3.0:1784186415.296514:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937922304 00000100:00100000:3.0:1784186415.296544:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784186415.296551:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937922304:12345-0@lo:503: 00000100:00100000:3.0:1784186415.296838:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937922304:12345-0@lo:503: Request processed in 287us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186415.296846:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784186415.296885:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922304:0@lo:503: 00000100:00100000:3.0:1784186415.297429:0:7854:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7854:1870854937922432:0@lo:502: 00000100:00100000:3.0:1784186415.297493:0:7854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.297517:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937922432 00000100:00100000:3.0:1784186415.297522:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937922432 00000100:00100000:3.0:1784186415.297545:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784186415.297553:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7854:x1870854937922432:12345-0@lo:502: 00000100:00100000:3.0:1784186415.297771:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7854:x1870854937922432:12345-0@lo:502: Request processed in 217us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186415.297777:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784186415.297806:0:7854:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186415.297817:0:7854:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7854:1870854937922432:0@lo:502: 00000100:00100000:3.0:1784186415.297855:0:7854:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7854:1870854937922560:0@lo:502: 00000100:00100000:3.0:1784186415.297885:0:7854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.297901:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937922560 00000100:00100000:3.0:1784186415.298384:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937922560 00000100:00100000:3.0:1784186415.298423:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784186415.298430:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7854:x1870854937922560:12345-0@lo:502: 00000100:00100000:3.0:1784186415.298599:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:7854:x1870854937922560:12345-0@lo:502: Request processed in 169us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186415.298630:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784186415.298659:0:7854:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186415.298673:0:7854:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7854:1870854937922560:0@lo:502: 00000040:00080000:3.0:1784186415.298693:0:7854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1784186415.298749:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1784186415.298764:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784186415.298772:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.298783:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186415.298791:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784186415.298794:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1784186415.298797:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784186415.298819:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.298827:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.298836:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186415.298846:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922688:0@lo:101: 00000100:00100000:3.0:1784186415.298872:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.298883:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.300366:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937922688 00000100:00100000:2.0:1784186415.300377:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937922688 00000100:00100000:2.0:1784186415.300422:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784186415.300430:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937922688:12345-0@lo:101: 00010000:00010000:2.0:1784186415.300455:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186415.300470:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda505c00/0x55bc3e8c99d19046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1903f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.300492:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda505c00/0x55bc3e8c99d19046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1903f expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.300503:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda505c00/0x55bc3e8c99d19046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1903f expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.300511:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505c00, rc 0) 00000100:00100000:2.0:1784186415.300570:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937922688:12345-0@lo:101: Request processed in 141us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.300577:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784186415.300648:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922688:0@lo:101: 00010000:00010000:2.0:1784186415.300663:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.300672:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186415.300746:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922816:0@lo:501: 00000100:00100000:2.0:1784186415.300775:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186415.300793:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21e300 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.300804:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937922816 00000100:00100000:2.0:1784186415.300807:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937922816 00000100:00100000:2.0:1784186415.300823:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784186415.300828:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937922816:12345-0@lo:501: 00000100:00100000:2.0:1784186415.301060:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937922816:12345-0@lo:501: Request processed in 230us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.301067:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784186415.301094:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922816:0@lo:501: 00000100:00100000:2.0:1784186415.301353:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922944:0@lo:503: 00000100:00100000:2.0:1784186415.301385:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186415.301396:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21e300 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.301408:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937922944 00000100:00100000:2.0:1784186415.301411:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937922944 00000100:00100000:2.0:1784186415.301429:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784186415.301435:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937922944:12345-0@lo:503: 00000100:00100000:2.0:1784186415.301724:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937922944:12345-0@lo:503: Request processed in 289us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.301730:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1784186415.301762:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937922944:0@lo:503: 00000100:00100000:2.0:1784186415.301918:0:7855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7855:1870854937923072:0@lo:502: 00000100:00100000:2.0:1784186415.301946:0:7855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186415.301966:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937923072 00000100:00100000:2.0:1784186415.301969:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937923072 00000100:00100000:2.0:1784186415.301986:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784186415.301991:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+15:7855:x1870854937923072:12345-0@lo:502: 00000100:00100000:2.0:1784186415.302147:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+15:7855:x1870854937923072:12345-0@lo:502: Request processed in 154us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.302153:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784186415.304317:0:7855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.304354:0:7855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7855:1870854937923072:0@lo:502: 00000020:01000000:2.0:1784186415.304387:0:7855:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186415.304396:0:7855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186415.304399:0:7855:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784186415.304404:0:7855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784186415.304406:0:7855:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784186415.304434:0:7855:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7855:1870854937923200:0@lo:502: 00000100:00100000:2.0:1784186415.304508:0:7855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186415.304540:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937923200 00000100:00100000:2.0:1784186415.304545:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937923200 00000100:00100000:2.0:1784186415.304578:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784186415.304585:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:7855:x1870854937923200:12345-0@lo:502: 00000100:00100000:2.0:1784186415.305398:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:7855:x1870854937923200:12345-0@lo:502: Request processed in 809us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.305407:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784186415.305480:0:7855:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.305496:0:7855:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7855:1870854937923200:0@lo:502: 00000020:01000000:2.0:1784186415.305516:0:7855:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186415.305521:0:7855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186415.305523:0:7855:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784186415.305533:0:7855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1784186415.309582:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1784186415.309640:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784186415.309666:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.309679:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186415.309690:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784186415.309693:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9fc5f8f800 from 30 10000000:01000000:3.0:1784186415.309696:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784186415.309734:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.309743:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.309755:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186415.309779:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937923328:0@lo:101: 00000100:00100000:3.0:1784186415.309848:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.309894:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65300 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.311483:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937923328 00000100:00100000:2.0:1784186415.311495:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937923328 00000100:00100000:2.0:1784186415.311548:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784186415.311556:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937923328:12345-0@lo:101: 00010000:00010000:2.0:1784186415.311569:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186415.311583:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda505e00/0x55bc3e8c99d19054 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1904d expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.311606:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda505e00/0x55bc3e8c99d19054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1904d expref: 16 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.311615:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda505e00/0x55bc3e8c99d19054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1904d expref: 16 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.311623:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505e00, rc 0) 00000100:00100000:2.0:1784186415.311674:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937923328:12345-0@lo:101: Request processed in 119us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.311680:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784186415.311948:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937923328:0@lo:101: 00010000:00010000:3.0:1784186415.311965:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.311974:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186415.312280:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937923456:0@lo:501: 00000100:00100000:3.0:1784186415.312324:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.312964:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65300 going to sleep for 11 seconds 00000100:00100000:1.0:1784186415.324631:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937923456 00000100:00100000:1.0:1784186415.324647:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937923456 00000100:00100000:1.0:1784186415.324719:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784186415.324730:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937923456:12345-0@lo:501: 00000100:00100000:1.0:1784186415.325310:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937923456:12345-0@lo:501: Request processed in 579us (12982us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186415.325319:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784186415.325381:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937923456:0@lo:501: 00000100:00100000:1.0:1784186415.325432:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937923584:0@lo:503: 00000100:00100000:1.0:1784186415.325503:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186415.325539:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcd745540 going to sleep for 11 seconds 00000100:00100000:1.0:1784186415.325552:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937923584 00000100:00100000:1.0:1784186415.325556:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937923584 00000100:00100000:1.0:1784186415.325581:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784186415.325587:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937923584:12345-0@lo:503: 00000100:00100000:1.0:1784186415.325725:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937923584:12345-0@lo:503: Request processed in 137us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186415.325731:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784186415.325768:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937923584:0@lo:503: 00000100:00100000:1.0:1784186415.328349:0:7858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7858:1870854937923712:0@lo:502: 00000100:00100000:1.0:1784186415.328423:0:7858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186415.328491:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937923712 00000100:00100000:1.0:1784186415.328498:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937923712 00000100:00100000:1.0:1784186415.328539:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784186415.328547:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+16:7858:x1870854937923712:12345-0@lo:502: 00000100:00100000:1.0:1784186415.328787:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+16:7858:x1870854937923712:12345-0@lo:502: Request processed in 239us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186415.328795:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784186415.328846:0:7858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccd396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186415.328868:0:7858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7858:1870854937923712:0@lo:502: 00000100:00100000:1.0:1784186415.331776:0:7858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7858:1870854937923840:0@lo:502: 00000100:00100000:1.0:1784186415.331860:0:7858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186415.331922:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937923840 00000100:00100000:1.0:1784186415.331928:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937923840 00000100:00100000:1.0:1784186415.331975:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784186415.331984:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+16:7858:x1870854937923840:12345-0@lo:502: 00000100:00100000:1.0:1784186415.332263:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+16:7858:x1870854937923840:12345-0@lo:502: Request processed in 280us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186415.332270:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784186415.332323:0:7858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccd396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186415.332343:0:7858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7858:1870854937923840:0@lo:502: 00000040:00080000:1.0:1784186415.332368:0:7858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1784186415.332425:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1784186415.332463:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784186415.332472:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186415.332482:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186415.332490:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784186415.332492:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b9fc5f8f800 from 5 10000000:01000000:1.0:1784186415.332495:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784186415.332518:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186415.332525:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186415.332534:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186415.332546:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937923968:0@lo:101: 00000100:00100000:1.0:1784186415.332570:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186415.332598:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccd396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.335183:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937923968 00000100:00100000:2.0:1784186415.335197:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937923968 00000100:00100000:2.0:1784186415.335242:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784186415.335250:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937923968:12345-0@lo:101: 00010000:00010000:2.0:1784186415.335265:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186415.335282:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda505000/0x55bc3e8c99d19062 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1905b expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.335308:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda505000/0x55bc3e8c99d19062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1905b expref: 17 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.335329:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda505000/0x55bc3e8c99d19062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1905b expref: 17 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.335338:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505000, rc 0) 00000100:00100000:2.0:1784186415.335400:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937923968:12345-0@lo:101: Request processed in 150us (2828us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.335406:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784186415.338881:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937923968:0@lo:101: 00010000:00010000:1.0:1784186415.338924:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186415.338938:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186415.339016:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937924096:0@lo:256: 00000100:00100000:1.0:1784186415.339372:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186415.339424:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccd396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.339570:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937924096 00000100:00100000:2.0:1784186415.339578:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937924096 00000100:00100000:2.0:1784186415.339631:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784186415.339642:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937924096:12345-0@lo:256: 20000000:01000000:2.0:1784186415.339662:0:5774:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784186415.339679:0:5774:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784186415.339683:0:5774:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1784186415.343389:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937924096:12345-0@lo:256: Request processed in 3740us (4009us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.343403:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784186415.346559:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937924096:0@lo:256: 10000000:01000000:1.0:1784186415.346642:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784186415.346654:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186415.346664:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186415.346674:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784186415.346676:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1784186415.346679:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784186415.346711:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186415.346720:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186415.346730:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186415.346758:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937924224:0@lo:101: 00000100:00100000:1.0:1784186415.346816:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186415.346867:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccd396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.347132:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937924224 00000100:00100000:2.0:1784186415.347139:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937924224 00000100:00100000:2.0:1784186415.347196:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784186415.347205:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937924224:12345-0@lo:101: 00010000:00010000:2.0:1784186415.347217:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186415.347229:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda504200/0x55bc3e8c99d19070 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d19069 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.347252:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda504200/0x55bc3e8c99d19070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d19069 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.347272:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda504200/0x55bc3e8c99d19070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19069 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186415.347281:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504200, rc 0) 00000100:00100000:2.0:1784186415.347319:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937924224:12345-0@lo:101: Request processed in 115us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.347326:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784186415.347714:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937924224:0@lo:101: 00010000:00010000:1.0:1784186415.347730:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186415.347741:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186415.347791:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937924352:0@lo:501: 00000100:00100000:1.0:1784186415.347822:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186415.347846:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccd396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186415.347861:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937924352 00000100:00100000:1.0:1784186415.347864:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937924352 00000100:00100000:1.0:1784186415.347891:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784186415.347898:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937924352:12345-0@lo:501: 00000100:00100000:1.0:1784186415.348648:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937924352:12345-0@lo:501: Request processed in 748us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186415.348656:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784186415.354595:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937924352:0@lo:501: 00000100:00100000:2.0:1784186415.354776:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937924480:0@lo:503: 00000100:00100000:2.0:1784186415.354852:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186415.354953:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb3cb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186415.358986:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937924480 00000100:00100000:1.0:1784186415.359003:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937924480 00000100:00100000:1.0:1784186415.359131:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784186415.359142:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937924480:12345-0@lo:503: 00000100:00100000:1.0:1784186415.359655:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937924480:12345-0@lo:503: Request processed in 513us (4801us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186415.359673:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784186415.360344:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937924480:0@lo:503: 00000100:00100000:3.0:1784186415.377148:0:7861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7861:1870854937924608:0@lo:502: 00000100:00100000:3.0:1784186415.377393:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.377462:0:7861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec650c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186415.377555:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937924608 00000100:00100000:1.0:1784186415.377563:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937924608 00000100:00100000:1.0:1784186415.377601:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784186415.377609:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:7861:x1870854937924608:12345-0@lo:502: 00000100:00100000:1.0:1784186415.377894:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:7861:x1870854937924608:12345-0@lo:502: Request processed in 285us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186415.377913:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784186415.378352:0:7861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7861:1870854937924608:0@lo:502: 00000020:01000000:3.0:1784186415.378386:0:7861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784186415.378394:0:7861:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1784186415.378401:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186415.378403:0:7861:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784186415.378408:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784186415.378412:0:7861:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:3.0:1784186415.378435:0:7861:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784186415.378438:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784186415.378482:0:7861:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b9fd1850000) 00000020:00000080:3.0:1784186415.378506:0:7861:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1784186415.378512:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784186415.378596:0:7861:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784186415.378601:0:7861:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784186415.378607:0:7861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d1907e 00010000:00080000:3.0:1784186415.378645:0:7861:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b9fef86a000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1784186415.378871:0:7861:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1784186415.381691:0:7861:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1784186415.381711:0:7861:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784186415.384951:0:7861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784186415.385356:0:7861:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784186415.385408:0:7861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1784186415.385501:0:7861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1784186415.386529:0:7863:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784186415.386535:0:7863:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784186415.394573:0:7861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784186415.402096:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784186415.402317:0:7861:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784186415.402347:0:7861:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x55bc3e8c99d19085 00000100:00080000:2.0:1784186415.402358:0:7861:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784186415.402366:0:7861:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b9fef86a000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1784186415.402401:0:7861:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffede6680 x1870854937924736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784186415.402473:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937924736:0@lo:8: 00000100:00100000:0.0:1784186415.402554:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784186415.403229:0:7861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784186415.403329:0:7861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186415.403335:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186415.403336:0:7861:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784186415.403339:0:7861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186415.403343:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186415.403344:0:7861:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784186415.403347:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784186415.403349:0:7861:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784186415.403385:0:7861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7861:1870854937924864:0@lo:502: 00000100:00100000:2.0:1784186415.403438:0:7861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186415.403488:0:7861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21e300 going to sleep for 11 seconds 00000100:00100000:3.0:1784186415.403651:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937925120:0@lo:400: 00000100:00100000:3.0:1784186415.403682:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.403704:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784186415.403710:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937924992:0@lo:400: 00000100:00100000:3.0:1784186415.403733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.403754:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937925248:0@lo:400: 00000100:00100000:3.0:1784186415.403776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.403791:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784186415.403796:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937925376:0@lo:400: 00000100:00100000:3.0:1784186415.403828:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.403855:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937924736 00000100:00100000:3.0:1784186415.403862:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937924736 00000100:00100000:3.0:1784186415.403890:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937925248 00000100:00100000:3.0:1784186415.403893:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937925248 00000100:00100000:3.0:1784186415.403918:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784186415.403925:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937925248:12345-0@lo:400: 00000100:00100000:3.0:1784186415.403971:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937925248:12345-0@lo:400: Request processed in 46us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186415.403978:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784186415.403992:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784186415.403995:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1870854937924736:12345-0@lo:8: 00010000:00080000:3.0:1784186415.404016:0:6583:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:3.0:1784186415.404040:0:6583:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x55bc3e8c99d1908c 00002000:00100000:3.0:1784186415.404065:0:6583:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b9fef86e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1784186415.404069:0:6583:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1784186415.404072:0:6583:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1784186415.404202:0:6583:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784186415.404352:0:6583:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784186415.404376:0:6583:0:(import.c:65:import_set_state_nolock()) ffff9b9fef868800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784186415.404668:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937924864 00000100:00100000:1.0:1784186415.404674:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937924864 00000100:00100000:1.0:1784186415.404703:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784186415.404709:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:7861:x1870854937924864:12345-0@lo:502: 00000100:00100000:1.0:1784186415.404942:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:7861:x1870854937924864:12345-0@lo:502: Request processed in 233us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186415.404949:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784186415.404993:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937925120 00000100:00100000:1.0:1784186415.404997:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937925120 00000100:00100000:1.0:1784186415.405026:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937924992 00000100:00100000:1.0:1784186415.405029:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937924992 00000100:00100000:1.0:1784186415.405038:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937925376 00000100:00100000:1.0:1784186415.405040:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937925376 00000100:00100000:1.0:1784186415.405064:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784186415.405070:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937925120:12345-0@lo:400: 00000100:00100000:1.0:1784186415.405118:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937925120:12345-0@lo:400: Request processed in 47us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186415.405334:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784186415.405349:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784186415.405362:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937924992:12345-0@lo:400: 00000100:00100000:1.0:1784186415.405390:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937924992:12345-0@lo:400: Request processed in 29us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186415.405396:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784186415.405407:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784186415.405413:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937925376:12345-0@lo:400: 00000100:00100000:1.0:1784186415.405479:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937925376:12345-0@lo:400: Request processed in 27us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186415.405485:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1784186415.405508:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784186415.405541:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c59180 x1870854937924992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186415.405556:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937924992:0@lo:400: 00010000:00080000:1.0:1784186415.405569:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c5a680 x1870854937925120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186415.405577:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937925120:0@lo:400: 00000100:00100000:2.0:1784186415.408003:0:7861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:7861:1870854937924864:0@lo:502: 00000020:01000000:2.0:1784186415.408072:0:7861:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186415.408081:0:7861:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186415.408084:0:7861:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784186415.408099:0:7861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1784186415.408943:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1784186415.408966:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784186415.408977:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186415.408989:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186415.409000:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784186415.409003:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b9fc7763380 from 1 10000000:01000000:1.0:1784186415.409017:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:3.0:1784186415.409554:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1870854937924736:12345-0@lo:8: Request processed in 5551us (6994us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186415.409564:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1784186415.409631:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5579500 x1870854937925376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186415.409646:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937925376:0@lo:400: 00010000:00080000:3.0:1784186415.409661:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c58700 x1870854937925248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186415.409669:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937925248:0@lo:400: 00010000:00010000:1.0:1784186415.413343:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186415.413363:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186415.413375:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186415.413400:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd540700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937925504:0@lo:101: 00000100:00100000:1.0:1784186415.413495:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186415.413538:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc76963c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186415.414341:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937925504 00000100:00100000:3.0:1784186415.414349:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937925504 00000100:00100000:3.0:1784186415.414407:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784186415.414416:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937925504:12345-0@lo:101: 00010000:00010000:3.0:1784186415.414429:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186415.414458:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17e00/0x55bc3e8c99d1909a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d19093 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.414482:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17e00/0x55bc3e8c99d1909a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d19093 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.414491:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf17e00/0x55bc3e8c99d1909a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19093 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.414499:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17e00, rc 0) 00000100:00100000:3.0:1784186415.414549:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937925504:12345-0@lo:101: Request processed in 135us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186415.414563:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784186415.414609:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd540700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937925504:0@lo:101: 00010000:00010000:3.0:1784186415.414625:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.414634:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186415.414693:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937925632:0@lo:501: 00000100:00100000:3.0:1784186415.414721:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.414737:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc30550c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186415.414751:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937925632 00000100:00100000:3.0:1784186415.414753:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937925632 00000100:00100000:3.0:1784186415.414774:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784186415.414779:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937925632:12345-0@lo:501: 00000100:00100000:3.0:1784186415.414982:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937925632:12345-0@lo:501: Request processed in 202us (259us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784186415.414989:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784186415.415016:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937925632:0@lo:501: 10000000:01000000:3.0:1784186415.415036:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784186415.415054:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186415.415063:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1784186415.419578:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffede6680 x1870854937924736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784186425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186415.419595:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784186415.419605:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784186415.419614:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784186415.419620:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784186415.419623:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fef86a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784186415.419651:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784186415.419658:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937924736:0@lo:8: 00000004:00080000:0.0:1784186415.419705:0:7863:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784186415.419842:0:7863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 194141399817ns, next at 0ns, rc = 0 00000004:00080000:3.0:1784186415.530437:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1784186415.589772:0:7864:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1784186415.589804:0:7864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7864:1870854937925888:0@lo:7: 00000100:00100000:3.0:1784186415.589886:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.590060:0:7864:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccb8c000 going to sleep for 11 seconds 00000100:00100000:3.0:1784186415.590093:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937925760:0@lo:13: 00000100:00100000:3.0:1784186415.590119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.590155:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937925888 00000100:00100000:3.0:1784186415.590162:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937925888 00000100:00100000:3.0:1784186415.590214:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186415.590223:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7864:x1870854937925888:12345-0@lo:7: 00002000:00080000:3.0:1784186415.596567:0:6581:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1784186415.596576:0:6581:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1784186415.596675:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7864:x1870854937925888:12345-0@lo:7: Request processed in 6449us (6785us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186415.596686:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186415.596735:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937925760 00000100:00100000:3.0:1784186415.596742:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937925760 00000100:00100000:3.0:1784186415.596785:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186415.596792:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937925760:12345-0@lo:13: 00002000:00000024:3.0:1784186415.596816:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1784186415.596848:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937925760:12345-0@lo:13: Request processed in 56us (6728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186415.596854:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1784186415.596896:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5579500 x1870854937925760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186415.596916:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937925760:0@lo:13: 00010000:00080000:0.0:1784186415.597388:0:7864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5579180 x1870854937925888/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784186431 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186415.597399:0:7864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7864:1870854937925888:0@lo:7: 00000004:00080000:0.0:1784186415.597409:0:7864:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1784186415.597463:0:7864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7864:1870854937926016:0@lo:5: 00000100:00100000:0.0:1784186415.597504:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186415.597534:0:7864:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe23b300 going to sleep for 11 seconds 00000100:00080000:1.0:1784186415.597936:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186415.598064:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937926016 00000100:00100000:3.0:1784186415.598077:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937926016 00000100:00100000:3.0:1784186415.598656:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784186415.598668:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7864:x1870854937926016:12345-0@lo:5: 00002000:00080000:3.0:1784186415.598694:0:6584:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784186415.598698:0:6584:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1784186415.599231:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7864:x1870854937926016:12345-0@lo:5: Request processed in 565us (1725us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784186415.599239:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1784186415.601605:0:7864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffd9de680 x1870854937926016/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784186431 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186415.601628:0:7864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7864:1870854937926016:0@lo:5: 00000004:00080000:3.0:1784186415.601642:0:7864:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1784186415.601685:0:7864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7864:1870854937926144:0@lo:700: 00000100:00100000:3.0:1784186415.601750:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.601793:0:7864:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccb8cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784186415.602363:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937926144 00000100:00100000:2.0:1784186415.602372:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937926144 00000100:00100000:2.0:1784186415.602427:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784186415.602437:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7864:x1870854937926144:12345-0@lo:700: 00000100:00100000:2.0:1784186415.602498:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6590:1870854937926272:0@lo:700: 00000100:00100000:2.0:1784186415.602534:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186415.602556:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1233000 going to sleep for 11 seconds 00000100:00100000:0.0:1784186415.602675:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937926272 00000100:00100000:0.0:1784186415.602680:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937926272 00000100:00100000:0.0:1784186415.602715:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784186415.602722:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6590:x1870854937926272:12345-0@lo:700: 40000000:02000000:2.0:1784186415.658467:0:5789:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1784186415.666923:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6590:x1870854937926272:12345-0@lo:700: Request processed in 64192us (64379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186415.666937:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784186415.667000:0:6590:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffede6300 x1870854937926272/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784186431 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186415.667016:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6590:1870854937926272:0@lo:700: 40000000:02000000:3.0:1784186415.667029:0:6590:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1784186415.779214:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7864:x1870854937926144:12345-0@lo:700: Request processed in 176768us (177453us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186415.779235:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:0.0:1784186415.779287:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1784186415.779298:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1784186415.780178:0:7864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5579500 x1870854937926144/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784186431 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186415.780195:0:7864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7864:1870854937926144:0@lo:700: 00000004:02000040:2.0:1784186415.859742:0:7864:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1784186415.868935:0:7864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7864:1870854937926400:0@lo:5: 00000100:00100000:3.0:1784186415.869085:0:7864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186415.869254:0:7864:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1233900 going to sleep for 11 seconds 00000100:00100000:0.0:1784186415.872252:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937926400 00000100:00100000:0.0:1784186415.872268:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937926400 00000100:00100000:0.0:1784186415.872342:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784186415.872353:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7864:x1870854937926400:12345-0@lo:5: 00002000:00080000:1.0:1784186415.878982:0:6583:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1784186415.879004:0:6583:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1784186415.887834:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5578e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7864:x1870854937926400:12345-0@lo:5: Request processed in 15475us (18814us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784186415.887847:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1784186415.887926:0:7864:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5579500 x1870854937926400/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784186431 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186415.887940:0:7864:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784186415.887954:0:7864:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9b9fe5579500 x1870854937926400/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784186431 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186415.887964:0:7864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7864:1870854937926400:0@lo:5: 00000004:00080000:3.0:1784186415.887978:0:7864:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1784186416.125686:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186417.149625:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186418.173938:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186419.198030:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186419.389699:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937926528:0@lo:13: 00000100:00100000:1.0:1784186419.389766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186419.402371:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937926528 00000100:00100000:2.0:1784186419.402387:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937926528 00000100:00100000:2.0:1784186419.402492:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784186419.402504:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937926528:12345-0@lo:13: 00002000:00000024:2.0:1784186419.402550:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186419.402651:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937926528:12345-0@lo:13: Request processed in 150us (12883us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186419.402657:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1784186419.402708:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffede4380 x1870854937926528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186419.402727:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937926528:0@lo:13: 00000100:00080000:1.0:1784186419.405276:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1784186420.149394:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1784186420.223553:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186420.417463:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937926784:0@lo:400: 00000100:00100000:3.0:1784186420.417531:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186420.417583:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937927296:0@lo:400: 00000100:00100000:3.0:1784186420.417609:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186420.417639:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784186420.417644:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937926656:0@lo:400: 00000100:00100000:3.0:1784186420.417672:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186420.417692:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937927168:0@lo:400: 00000100:00100000:3.0:1784186420.417716:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186420.417741:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937926912:0@lo:400: 00000100:00100000:3.0:1784186420.417786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186420.417807:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186420.417812:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937927040:0@lo:400: 00000100:00100000:3.0:1784186420.417848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186420.417881:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937926784 00000100:00100000:3.0:1784186420.417890:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937926784 00000100:00100000:3.0:1784186420.417931:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937927168 00000100:00100000:3.0:1784186420.417934:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937927168 00000100:00100000:3.0:1784186420.417984:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937926912 00000100:00100000:3.0:1784186420.417988:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937926912 00000100:00100000:3.0:1784186420.418005:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784186420.418012:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937926784:12345-0@lo:400: 00000100:00100000:3.0:1784186420.418653:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937926784:12345-0@lo:400: Request processed in 639us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186420.418662:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784186420.418684:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784186420.418690:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937927168:12345-0@lo:400: 00000100:00100000:3.0:1784186420.418717:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937927168:12345-0@lo:400: Request processed in 27us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186420.418722:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784186420.418733:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784186420.418738:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937926912:12345-0@lo:400: 00000100:00100000:3.0:1784186420.418764:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937926912:12345-0@lo:400: Request processed in 26us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186420.418770:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784186420.418788:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937927296 00000100:00100000:3.0:1784186420.418792:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937927296 00000100:00100000:3.0:1784186420.418818:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937927040 00000100:00100000:3.0:1784186420.418882:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937927040 00000100:00100000:3.0:1784186420.418904:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186420.418909:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937927296:12345-0@lo:400: 00000100:00100000:3.0:1784186420.418938:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937927296:12345-0@lo:400: Request processed in 29us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186420.418944:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186420.419335:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784186420.419424:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937927040:12345-0@lo:400: 00000100:00100000:3.0:1784186420.419491:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937927040:12345-0@lo:400: Request processed in 71us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186420.419497:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784186420.419516:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937926656 00000100:00100000:3.0:1784186420.419519:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937926656 00000100:00100000:3.0:1784186420.419544:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784186420.419550:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937926656:12345-0@lo:400: 00000100:00100000:3.0:1784186420.419580:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937926656:12345-0@lo:400: Request processed in 30us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186420.419586:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1784186420.420565:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784186420.420572:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784186420.420624:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5579c00 x1870854937927040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186420.420640:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937927040:0@lo:400: 00010000:00080000:3.0:1784186420.420652:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe557aa00 x1870854937926912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186420.420660:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937926912:0@lo:400: 00000100:00100000:3.0:1784186420.420697:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937926656:0@lo:400: 00010000:00080000:3.0:1784186420.420709:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5578700 x1870854937927168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186420.420716:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937927168:0@lo:400: 00010000:00080000:3.0:1784186420.420728:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe557a680 x1870854937926784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186420.420752:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937926784:0@lo:400: 00010000:00080000:3.0:1784186420.420765:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5579f80 x1870854937927296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186420.420771:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784186420.420781:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937927296:0@lo:400: 00000100:00100000:1.0:1784186420.927079:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784186420.927108:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937927424:0@lo:13: 00000100:00100000:1.0:1784186420.927187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186420.927541:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937927424 00000100:00100000:3.0:1784186420.927550:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937927424 00000100:00100000:3.0:1784186420.927603:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784186420.927613:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937927424:12345-0@lo:13: 00002000:00000024:3.0:1784186420.927647:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186420.927697:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937927424:12345-0@lo:13: Request processed in 86us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186420.927704:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1784186420.927765:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe83ca80 x1870854937927424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186420.927785:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937927424:0@lo:13: 00010000:00010000:0.0:1784186421.248500:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186422.035507:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186422.035599:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915883392 00000100:00100000:2.0:1784186422.035609:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915883392 00000100:00100000:2.0:1784186422.035652:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 112 00000100:00100000:2.0:1784186422.035659:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1870854915883392:12345-192.168.201.31@tcp:250: 00010000:00080000:2.0:1784186422.035687:0:5774:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from b4228b22-4257-4c36-8c46-fa9ee5db5ed6@192.168.201.31@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1784186422.035715:0:5774:0:(genops.c:1406:class_connect()) connect: client b4228b22-4257-4c36-8c46-fa9ee5db5ed6, cookie 0x55bc3e8c99d190a1 00000100:00080000:2.0:1784186422.035842:0:5774:0:(import.c:65:import_set_state_nolock()) ffff9b9ffdf0a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784186422.035917:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+5:2353:x1870854915883392:12345-192.168.201.31@tcp:250: Request processed in 256us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186422.035924:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 112 00000100:00100000:1.0:1784186422.041417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186422.041737:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915883264 00000100:00100000:3.0:1784186422.041747:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915883264 00000100:00100000:3.0:1784186422.041806:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 113 00000100:00100000:3.0:1784186422.041815:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+5:5558:x1870854915883264:12345-192.168.201.31@tcp:101: 00010000:00010000:3.0:1784186422.041832:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186422.041849:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17000/0x55bc3e8c99d190a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576391 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186422.041877:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17000/0x55bc3e8c99d190a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576391 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186422.041905:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf17000/0x55bc3e8c99d190a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576391 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186422.041915:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17000, rc 0) 00000100:00100000:3.0:1784186422.043731:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+6:5558:x1870854915883264:12345-192.168.201.31@tcp:101: Request processed in 1904us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186422.043743:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 113 00000100:00100000:0.0:1784186422.057584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186422.057694:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915883520 00000100:00100000:2.0:1784186422.057704:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915883520 00000100:00100000:2.0:1784186422.057757:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 114 00000100:00100000:2.0:1784186422.057767:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+6:5558:x1870854915883520:12345-192.168.201.31@tcp:501: 00000100:00100000:2.0:1784186422.058171:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+6:5558:x1870854915883520:12345-192.168.201.31@tcp:501: Request processed in 403us (594us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784186422.058180:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 114 00000100:00100000:1.0:1784186422.068545:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186422.068832:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915883648 00000100:00100000:3.0:1784186422.068842:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915883648 00000100:00100000:3.0:1784186422.068893:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 115 00000100:00100000:3.0:1784186422.068908:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+6:5558:x1870854915883648:12345-192.168.201.31@tcp:101: 00010000:00010000:3.0:1784186422.068929:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186422.068954:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d190af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576398 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186422.068980:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d190af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576398 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186422.068991:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d190af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576398 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186422.069000:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17a00, rc 0) 00000100:00100000:3.0:1784186422.069051:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+7:5558:x1870854915883648:12345-192.168.201.31@tcp:101: Request processed in 144us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186422.069058:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 115 00000100:00100000:1.0:1784186422.083524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186422.083831:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915883776 00000100:00100000:0.0:1784186422.083840:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915883776 00000100:00100000:0.0:1784186422.083908:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 116 00000100:00100000:0.0:1784186422.083919:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+7:5558:x1870854915883776:12345-192.168.201.31@tcp:501: 00000100:00100000:0.0:1784186422.084247:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+8:5558:x1870854915883776:12345-192.168.201.31@tcp:501: Request processed in 329us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186422.084255:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 116 00000100:00100000:0.0:1784186422.092145:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186422.092308:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915883904 00000100:00100000:2.0:1784186422.092319:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915883904 00000100:00100000:2.0:1784186422.092375:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:2.0:1784186422.092411:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+8:5558:x1870854915883904:12345-192.168.201.31@tcp:503: 00000100:00100000:2.0:1784186422.092833:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+8:5558:x1870854915883904:12345-192.168.201.31@tcp:503: Request processed in 424us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186422.092842:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:1.0:1784186422.097304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186422.101059:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915884032 00000100:00100000:3.0:1784186422.101080:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915884032 00000100:00100000:3.0:1784186422.101160:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:3.0:1784186422.101170:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+8:5576:x1870854915884032:12345-192.168.201.31@tcp:502: 00000100:00100000:3.0:1784186422.101577:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+8:5576:x1870854915884032:12345-192.168.201.31@tcp:502: Request processed in 406us (4282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186422.101586:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:1.0:1784186422.134810:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186422.134905:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915884160 00000100:00100000:0.0:1784186422.135019:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915884160 00000100:00100000:0.0:1784186422.135200:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 119 00000100:00100000:0.0:1784186422.135212:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+8:5576:x1870854915884160:12345-192.168.201.31@tcp:502: 00000100:00100000:0.0:1784186422.135698:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+8:5576:x1870854915884160:12345-192.168.201.31@tcp:502: Request processed in 486us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186422.137851:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 119 00000100:00100000:0.0:1784186422.147817:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186422.147962:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915884288 00000100:00100000:2.0:1784186422.147973:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915884288 00000100:00100000:2.0:1784186422.148037:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 120 00000100:00100000:2.0:1784186422.148047:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+8:5558:x1870854915884288:12345-192.168.201.31@tcp:101: 00010000:00010000:2.0:1784186422.148063:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186422.148089:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc766c200/0x55bc3e8c99d190b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5763c2 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186422.148115:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766c200/0x55bc3e8c99d190b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c2 expref: 9 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186422.148126:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc766c200/0x55bc3e8c99d190b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c2 expref: 9 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186422.148135:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c200, rc 0) 00000100:00100000:2.0:1784186422.148199:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:5558:x1870854915884288:12345-192.168.201.31@tcp:101: Request processed in 153us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186422.148206:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 120 00000100:00100000:2.0:1784186422.152547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186422.152633:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915884416 00000100:00100000:0.0:1784186422.152643:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915884416 00000100:00100000:0.0:1784186422.152695:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:0.0:1784186422.152705:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:5558:x1870854915884416:12345-192.168.201.31@tcp:256: 20000000:01000000:0.0:1784186422.152731:0:5774:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784186422.152754:0:5774:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784186422.152758:0:5774:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784186422.152761:0:5774:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784186422.152764:0:5774:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1784186422.154477:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:5558:x1870854915884416:12345-192.168.201.31@tcp:256: Request processed in 1768us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186422.154490:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:3.0:1784186422.158576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186422.158988:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915884544 00000100:00100000:0.0:1784186422.158998:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915884544 00000100:00100000:0.0:1784186422.159063:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:0.0:1784186422.159081:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:5558:x1870854915884544:12345-192.168.201.31@tcp:101: 00010000:00010000:0.0:1784186422.159097:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186422.159113:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9128400/0x55bc3e8c99d190bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5763c9 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186422.159153:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9128400/0x55bc3e8c99d190bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c9 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186422.159164:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9128400/0x55bc3e8c99d190bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c9 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186422.159172:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128400, rc 0) 00000100:00100000:0.0:1784186422.159235:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5558:x1870854915884544:12345-192.168.201.31@tcp:101: Request processed in 163us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186422.159241:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:2.0:1784186422.162366:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186422.162568:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915884672 00000100:00100000:0.0:1784186422.162577:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915884672 00000100:00100000:0.0:1784186422.162634:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:0.0:1784186422.162646:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5558:x1870854915884672:12345-192.168.201.31@tcp:501: 00000100:00100000:0.0:1784186422.163018:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5558:x1870854915884672:12345-192.168.201.31@tcp:501: Request processed in 373us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186422.163026:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:1.0:1784186422.172082:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186422.172296:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915884800 00000100:00100000:2.0:1784186422.172306:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915884800 00000100:00100000:2.0:1784186422.172360:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00100000:2.0:1784186422.172371:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5558:x1870854915884800:12345-192.168.201.31@tcp:503: 00000100:00100000:2.0:1784186422.172807:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5558:x1870854915884800:12345-192.168.201.31@tcp:503: Request processed in 437us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186422.172816:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00100000:1.0:1784186422.181685:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186422.181845:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915884928 00000100:00100000:3.0:1784186422.181855:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915884928 00000100:00100000:3.0:1784186422.181926:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:3.0:1784186422.181944:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5580:x1870854915884928:12345-192.168.201.31@tcp:502: 00000100:00100000:3.0:1784186422.182197:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5580:x1870854915884928:12345-192.168.201.31@tcp:502: Request processed in 255us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186422.182210:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:3.0:1784186422.183887:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186422.184024:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915885056 00000100:00100000:0.0:1784186422.184032:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915885056 00000100:00100000:0.0:1784186422.184082:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00100000:0.0:1784186422.184092:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5580:x1870854915885056:12345-192.168.201.31@tcp:502: 00000100:00100000:0.0:1784186422.184326:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5580:x1870854915885056:12345-192.168.201.31@tcp:502: Request processed in 234us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186422.184334:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00100000:1.0:1784186422.188237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186422.188333:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915885184 00000100:00100000:3.0:1784186422.188341:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915885184 00000100:00100000:3.0:1784186422.188401:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:3.0:1784186422.188409:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1870854915885184:12345-192.168.201.31@tcp:38: 00010000:00080000:3.0:1784186422.188438:0:5784:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1784186422.188524:0:5784:0:(genops.c:1406:class_connect()) connect: client efb6eb2c-5579-43c6-be4f-310412860e5b, cookie 0x55bc3e8c99d190c4 00000004:00100000:3.0:1784186422.188591:0:5784:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1784186422.188598:0:5784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1784186422.217775:0:5784:0:(import.c:65:import_set_state_nolock()) ffff9b9ec6816000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784186422.217860:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2353:x1870854915885184:12345-192.168.201.31@tcp:38: Request processed in 29449us (29630us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186422.217870:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00010000:00010000:1.0:1784186422.271015:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186423.241885:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186423.242012:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915885312 00000100:00100000:3.0:1784186423.242025:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915885312 00000100:00100000:3.0:1784186423.242108:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:3.0:1784186423.242119:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:0:x1870854915885312:12345-192.168.201.31@tcp:41: 00000004:00000024:3.0:1784186423.242181:0:5782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1784186423.242260:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:0:x1870854915885312:12345-192.168.201.31@tcp:41: Request processed in 142us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186423.242267:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00080000:1.0:1784186423.242339:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186423.243579:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186423.243664:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915885440 00000100:00100000:1.0:1784186423.243672:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915885440 00000100:00100000:1.0:1784186423.243716:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1784186423.243725:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:5558:x1870854915885440:12345-192.168.201.31@tcp:41: 00000004:00000024:1.0:1784186423.243747:0:7478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1784186423.243801:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:5558:x1870854915885440:12345-192.168.201.31@tcp:41: Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186423.243808:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:2.0:1784186423.248751:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186423.248868:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915885568 00000100:00100000:3.0:1784186423.248880:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915885568 00000100:00100000:3.0:1784186423.248950:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1784186423.248962:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:5558:x1870854915885568:12345-192.168.201.31@tcp:40: 00000100:00100000:3.0:1784186423.249075:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:5558:x1870854915885568:12345-192.168.201.31@tcp:40: Request processed in 116us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186423.249083:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:2.0:1784186423.252137:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186423.252241:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915886080 00000100:00100000:0.0:1784186423.252264:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915886080 00000100:00100000:0.0:1784186423.252329:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 127 00000100:00100000:0.0:1784186423.252350:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2354:x1870854915886080:12345-192.168.201.31@tcp:400: 00000100:00100000:0.0:1784186423.252433:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2354:x1870854915886080:12345-192.168.201.31@tcp:400: Request processed in 84us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186423.252487:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 127 00000100:00100000:3.0:1784186423.252628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186423.252731:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915885696 00000100:00100000:0.0:1784186423.252735:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915885696 00000100:00100000:0.0:1784186423.252758:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:0.0:1784186423.252764:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1870854915885696:12345-192.168.201.31@tcp:8: 00010000:00080000:0.0:1784186423.252787:0:6584:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:0.0:1784186423.252816:0:6584:0:(genops.c:1406:class_connect()) connect: client efb6eb2c-5579-43c6-be4f-310412860e5b, cookie 0x55bc3e8c99d190cb 00002000:00100000:0.0:1784186423.252827:0:6584:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli efb6eb2c-5579-43c6-be4f-310412860e5b/ffff9b9ec4a82800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784186423.252862:0:6584:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784186423.253693:0:6584:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784186423.253726:0:6584:0:(import.c:65:import_set_state_nolock()) ffff9b9ec4a81000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784186423.253787:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2353:x1870854915885696:12345-192.168.201.31@tcp:8: Request processed in 1020us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186423.253795:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:3.0:1784186423.254428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186423.254508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186423.254565:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915885952 00000100:00100000:1.0:1784186423.254572:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915885952 00000100:00100000:1.0:1784186423.254615:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:1.0:1784186423.254624:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:5558:x1870854915885952:12345-192.168.201.31@tcp:33: 00000100:00100000:0.0:1784186423.254752:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915885824 00000100:00100000:0.0:1784186423.254756:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915885824 00000100:00100000:0.0:1784186423.254788:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1784186423.254793:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1870854915885824:12345-192.168.201.31@tcp:8: 00010000:00080000:0.0:1784186423.254815:0:6583:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:0.0:1784186423.254840:0:6583:0:(genops.c:1406:class_connect()) connect: client efb6eb2c-5579-43c6-be4f-310412860e5b, cookie 0x55bc3e8c99d190d2 00002000:00100000:0.0:1784186423.254874:0:6583:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli efb6eb2c-5579-43c6-be4f-310412860e5b/ffff9b9ec4a80800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784186423.254905:0:6583:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784186423.255181:0:6583:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784186423.255203:0:6583:0:(import.c:65:import_set_state_nolock()) ffff9b9ec4a83800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784186423.255247:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2353:x1870854915885824:12345-192.168.201.31@tcp:8: Request processed in 453us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186423.255255:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000004:00080000:3.0:1784186423.330038:0:5785:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 75349us 00010000:00010000:0.0:1784186423.337624:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:1.0:1784186423.362334:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1784186423.362555:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:5558:x1870854915885952:12345-192.168.201.31@tcp:33: Request processed in 107926us (108040us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186423.362566:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:3.0:1784186423.537669:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186423.537852:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915886208 00000100:00100000:1.0:1784186423.537861:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915886208 00000100:00100000:1.0:1784186423.537954:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:1.0:1784186423.537965:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:5597:x1870854915886208:12345-192.168.201.31@tcp:101: 00010000:00010000:1.0:1784186423.537986:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186423.538021:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed000/0x55bc3e8c99d190d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5763f3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186423.538088:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed200/0x55bc3e8c99d190e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186423.538102:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed200/0x55bc3e8c99d190e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186423.538116:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed200/0x55bc3e8c99d190e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186423.538300:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784186423.538304:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784186423.538390:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed200/0x55bc3e8c99d190e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186423.538416:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed000/0x55bc3e8c99d190d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763f3 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186423.538432:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed200/0x55bc3e8c99d190e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763f3 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186423.538755:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd1d53700) 00010000:00010000:1.0:1784186423.538759:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784186423.538762:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ed200, rc 0) 00000100:00100000:1.0:1784186423.538822:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:5597:x1870854915886208:12345-192.168.201.31@tcp:101: Request processed in 859us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186423.538837:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00010000:00010000:1.0:1784186424.384952:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186424.509760:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937927552:0@lo:13: 00000100:00100000:3.0:1784186424.509827:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186424.510321:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937927552 00000100:00100000:0.0:1784186424.510330:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937927552 00000100:00100000:0.0:1784186424.510402:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784186424.510412:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937927552:12345-0@lo:13: 00002000:00000024:0.0:1784186424.510471:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1784186424.512612:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784186424.515479:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937927552:12345-0@lo:13: Request processed in 5057us (5639us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186424.515510:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1784186424.530993:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffede6d80 x1870854937927552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186424.531019:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937927552:0@lo:13: 00010000:00010000:0.0:1784186425.405584:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186425.533724:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937927680:0@lo:400: 00000100:00100000:0.0:1784186425.533795:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186425.534387:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937927808:0@lo:400: 00000100:00100000:1.0:1784186425.534427:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186425.534516:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937927808 00000100:00100000:1.0:1784186425.534522:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937927808 00000100:00100000:1.0:1784186425.534563:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784186425.534570:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937927808:12345-0@lo:400: 00000100:00100000:1.0:1784186425.534615:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937927808:12345-0@lo:400: Request processed in 45us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186425.534622:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784186425.534662:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937927808:0@lo:400: 00000100:00100000:3.0:1784186425.535034:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937927680 00000100:00100000:3.0:1784186425.535039:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937927680 00000100:00100000:3.0:1784186425.535073:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784186425.535079:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937927680:12345-0@lo:400: 00000100:00100000:2.0:1784186425.536468:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937928320:0@lo:400: 00000100:00100000:2.0:1784186425.536542:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186425.536582:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784186425.536589:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937928192:0@lo:400: 00000100:00100000:2.0:1784186425.536632:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186425.536667:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937928064:0@lo:400: 00000100:00100000:2.0:1784186425.536688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186425.536705:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784186425.536709:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937927936:0@lo:400: 00000100:00100000:2.0:1784186425.536725:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186425.536747:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937928320 00000100:00100000:2.0:1784186425.536753:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937928320 00000100:00100000:2.0:1784186425.536790:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937928064 00000100:00100000:2.0:1784186425.536792:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937928064 00000100:00100000:2.0:1784186425.536804:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784186425.536810:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937928320:12345-0@lo:400: 00000100:00100000:2.0:1784186425.536853:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937928320:12345-0@lo:400: Request processed in 43us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186425.536860:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784186425.536885:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784186425.536891:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937928064:12345-0@lo:400: 00000100:00100000:2.0:1784186425.537060:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937928064:12345-0@lo:400: Request processed in 168us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186425.537066:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784186425.537084:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937928192 00000100:00100000:2.0:1784186425.537088:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937928192 00000100:00100000:2.0:1784186425.537119:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937927936 00000100:00100000:2.0:1784186425.537122:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937927936 00000100:00100000:2.0:1784186425.537311:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784186425.537316:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937928192:12345-0@lo:400: 00000100:00100000:2.0:1784186425.537344:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937928192:12345-0@lo:400: Request processed in 28us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186425.537349:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784186425.537360:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784186425.537366:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937927936:12345-0@lo:400: 00000100:00100000:2.0:1784186425.537391:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937927936:12345-0@lo:400: Request processed in 25us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186425.537397:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784186425.537431:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937927936:0@lo:400: 00010000:00080000:2.0:1784186425.537464:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffede6680 x1870854937928064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186425.537474:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937928064:0@lo:400: 00000100:00100000:2.0:1784186425.537563:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937928192:0@lo:400: 00010000:00080000:2.0:1784186425.537574:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffede7800 x1870854937928320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186425.537583:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937928320:0@lo:400: 00000100:00100000:3.0:1784186425.537693:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937927680:12345-0@lo:400: Request processed in 2612us (3897us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186425.537702:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1784186425.537818:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784186425.537823:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784186425.538476:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937927680:0@lo:400: 00000100:00100000:3.0:1784186425.607797:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186425.608037:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915886336 00000100:00100000:0.0:1784186425.608048:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915886336 00000100:00100000:0.0:1784186425.608128:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1784186425.608138:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:5650:x1870854915886336:12345-192.168.201.31@tcp:41: 00000004:00000024:0.0:1784186425.608196:0:7478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1784186425.608263:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:5650:x1870854915886336:12345-192.168.201.31@tcp:41: Request processed in 125us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186425.608286:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00080000:1.0:1784186425.608459:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186425.615867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186425.616094:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915886464 00000100:00100000:2.0:1784186425.616104:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915886464 00000100:00100000:2.0:1784186425.616237:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:2.0:1784186425.616248:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efb6eb2c-5579-43c6-be4f-310412860e5b+6:5650:x1870854915886464:12345-192.168.201.31@tcp:13: 00002000:00000024:2.0:1784186425.616278:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186425.616358:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efb6eb2c-5579-43c6-be4f-310412860e5b+6:5650:x1870854915886464:12345-192.168.201.31@tcp:13: Request processed in 112us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186425.616367:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00080000:1.0:1784186425.616984:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784186425.618142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186425.618280:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915886592 00000100:00100000:2.0:1784186425.618287:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915886592 00000100:00080000:1.0:1784186425.618412:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784186425.618475:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:2.0:1784186425.618486:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efb6eb2c-5579-43c6-be4f-310412860e5b+6:5650:x1870854915886592:12345-192.168.201.31@tcp:13: 00002000:00000024:2.0:1784186425.618519:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186425.618579:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:efb6eb2c-5579-43c6-be4f-310412860e5b+6:5650:x1870854915886592:12345-192.168.201.31@tcp:13: Request processed in 95us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186425.618588:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:2.0:1784186426.046504:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784186426.046536:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937928448:0@lo:13: 00000100:00100000:2.0:1784186426.046612:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186426.047265:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937928448 00000100:00100000:1.0:1784186426.047276:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937928448 00000100:00100000:1.0:1784186426.047341:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784186426.047351:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937928448:12345-0@lo:13: 00002000:00000024:1.0:1784186426.047389:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186426.047475:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937928448:12345-0@lo:13: Request processed in 125us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186426.047483:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1784186426.047749:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe83e300 x1870854937928448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186426.047769:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937928448:0@lo:13: 00000001:00100000:1.0:1784186426.139758:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00010000:00010000:1.0:1784186426.430220:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186427.453860:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784186427.656305:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00000001:00100000:2.0:1784186427.710893:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00010000:00010000:3.0:1784186428.477912:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186428.761401:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186428.761437:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186428.761473:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186428.761495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186428.761520:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915886720 00000100:00100000:3.0:1784186428.761529:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915886720 00000100:00100000:3.0:1784186428.761574:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 129 00000100:00100000:3.0:1784186428.761584:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2357:x1870854915886720:12345-192.168.201.31@tcp:400: 00000100:00100000:3.0:1784186428.761648:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2357:x1870854915886720:12345-192.168.201.31@tcp:400: Request processed in 65us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186428.761657:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 129 00000100:00100000:3.0:1784186428.761687:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915886976 00000100:00100000:3.0:1784186428.761690:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915886976 00000100:00100000:3.0:1784186428.761723:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915887104 00000100:00100000:3.0:1784186428.761727:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915887104 00000100:00100000:3.0:1784186428.761742:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:3.0:1784186428.761747:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2357:x1870854915886976:12345-192.168.201.31@tcp:400: 00000100:00100000:3.0:1784186428.761774:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2357:x1870854915886976:12345-192.168.201.31@tcp:400: Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186428.761780:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:3.0:1784186428.761792:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:3.0:1784186428.761831:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2357:x1870854915887104:12345-192.168.201.31@tcp:400: 00000100:00100000:3.0:1784186428.761857:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2357:x1870854915887104:12345-192.168.201.31@tcp:400: Request processed in 38us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186428.761863:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:3.0:1784186428.761882:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915886848 00000100:00100000:3.0:1784186428.761886:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915886848 00000100:00100000:3.0:1784186428.762419:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:3.0:1784186428.762428:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915886848:12345-192.168.201.31@tcp:400: 00000100:00100000:3.0:1784186428.762474:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915886848:12345-192.168.201.31@tcp:400: Request processed in 48us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186428.762480:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00080000:3.0:1784186428.763482:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784186428.763489:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784186428.763491:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1784186429.118762:0:8135:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1784186429.513116:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186429.630292:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186429.630316:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937928576:0@lo:13: 00000100:00100000:1.0:1784186429.630381:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186429.630512:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937928576 00000100:00100000:2.0:1784186429.630521:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937928576 00000100:00100000:2.0:1784186429.630590:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784186429.630599:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937928576:12345-0@lo:13: 00002000:00000024:2.0:1784186429.630634:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186429.630679:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937928576:12345-0@lo:13: Request processed in 81us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186429.630699:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1784186429.630919:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784186429.630952:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe87dc00 x1870854937928576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186429.630972:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937928576:0@lo:13: 00010000:00010000:3.0:1784186430.544627:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186430.655936:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784186430.655963:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937928704:0@lo:400: 00000100:00100000:1.0:1784186430.656037:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186430.656114:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937928704 00000100:00100000:1.0:1784186430.656121:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937928704 00000100:00100000:1.0:1784186430.656167:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784186430.656177:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937928704:12345-0@lo:400: 00000100:00100000:0.0:1784186430.656179:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784186430.656193:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937928832:0@lo:400: 00000100:00100000:1.0:1784186430.656234:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937928704:12345-0@lo:400: Request processed in 58us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186430.656242:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186430.656246:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784186430.656279:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937928832 00000100:00100000:0.0:1784186430.656284:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937928832 00000100:00100000:1.0:1784186430.656310:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937928704:0@lo:400: 00000100:00100000:0.0:1784186430.656324:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784186430.656347:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937928832:12345-0@lo:400: 00000100:00100000:1.0:1784186430.656365:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937928960:0@lo:400: 00000100:00100000:0.0:1784186430.656396:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937928832:12345-0@lo:400: Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186430.656404:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186430.656409:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784186430.656424:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937928960 00000100:00100000:0.0:1784186430.656428:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937928960 00000100:00100000:1.0:1784186430.656489:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784186430.656497:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784186430.656500:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937929088:0@lo:400: 00000100:00100000:0.0:1784186430.656508:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937928960:12345-0@lo:400: 00000100:00100000:1.0:1784186430.656534:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186430.656551:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937928960:12345-0@lo:400: Request processed in 44us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186430.656560:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1784186430.656588:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186430.656590:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937928960:0@lo:400: 00000100:00100000:0.0:1784186430.656616:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937928832:0@lo:400: 00000100:00100000:1.0:1784186430.656621:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937929088 00000100:00100000:1.0:1784186430.656626:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937929088 00000100:00100000:1.0:1784186430.656662:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784186430.656672:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937929216:0@lo:400: 00000100:00100000:1.0:1784186430.656673:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937929088:12345-0@lo:400: 00000100:00100000:0.0:1784186430.656707:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186430.656732:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937929088:12345-0@lo:400: Request processed in 61us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186430.656740:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784186430.656752:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784186430.656760:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937929344:0@lo:400: 00000100:00100000:1.0:1784186430.656766:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937929216 00000100:00100000:1.0:1784186430.656772:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937929216 00000100:00100000:0.0:1784186430.656784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186430.656827:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784186430.656829:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937929344 00000100:00100000:0.0:1784186430.656834:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937929344 00000100:00100000:1.0:1784186430.656837:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937929216:12345-0@lo:400: 00000100:00100000:0.0:1784186430.656866:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784186430.656883:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937929216:12345-0@lo:400: Request processed in 47us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186430.656890:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937929344:12345-0@lo:400: 00000100:00100000:1.0:1784186430.656896:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1784186430.656915:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186430.656918:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784186430.656939:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffd542a00 x1870854937929088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186430.656950:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937929088:0@lo:400: 00000100:00100000:1.0:1784186430.656974:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937929216:0@lo:400: 00000100:00100000:1.0:1784186430.657730:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937929344:12345-0@lo:400: Request processed in 840us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186430.657739:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1784186430.659516:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffd9dd180 x1870854937929344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186430.659534:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937929344:0@lo:400: 00000100:00100000:0.0:1784186431.171145:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937929472:0@lo:13: 00000100:00100000:0.0:1784186431.171221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186431.171328:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937929472 00000100:00100000:1.0:1784186431.171336:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937929472 00000100:00100000:1.0:1784186431.171389:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784186431.171406:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937929472:12345-0@lo:13: 00002000:00000024:1.0:1784186431.171466:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186431.171511:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937929472:12345-0@lo:13: Request processed in 107us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186431.171518:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1784186431.172720:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffd542a00 x1870854937929472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186431.172744:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937929472:0@lo:13: 00010000:00010000:2.0:1784186431.549698:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186432.573814:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186433.597606:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186433.883407:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186433.883570:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186433.883597:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186433.883673:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186433.883706:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915887488 00000100:00100000:1.0:1784186433.883717:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915887488 00000100:00100000:1.0:1784186433.883780:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915887616 00000100:00100000:1.0:1784186433.883783:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915887616 00000100:00100000:1.0:1784186433.883803:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:1.0:1784186433.883812:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2357:x1870854915887488:12345-192.168.201.31@tcp:400: 00000100:00100000:1.0:1784186433.883882:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2357:x1870854915887488:12345-192.168.201.31@tcp:400: Request processed in 70us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186433.883890:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:1.0:1784186433.883910:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:1.0:1784186433.883917:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2357:x1870854915887616:12345-192.168.201.31@tcp:400: 00000100:00100000:1.0:1784186433.883942:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2357:x1870854915887616:12345-192.168.201.31@tcp:400: Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186433.883948:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00080000:1.0:1784186433.883969:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186433.883972:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784186433.898790:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915887232 00000100:00100000:0.0:1784186433.898805:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915887232 00000100:00100000:0.0:1784186433.898867:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 131 00000100:00100000:0.0:1784186433.898878:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2357:x1870854915887232:12345-192.168.201.31@tcp:400: 00000100:00100000:0.0:1784186433.898964:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2357:x1870854915887232:12345-192.168.201.31@tcp:400: Request processed in 87us (15567us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.898972:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 131 00000100:00100000:0.0:1784186433.899019:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915887360 00000100:00100000:0.0:1784186433.899023:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915887360 00000100:00100000:0.0:1784186433.899061:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:0.0:1784186433.899067:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915887360:12345-192.168.201.31@tcp:400: 00000100:00100000:0.0:1784186433.899096:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915887360:12345-192.168.201.31@tcp:400: Request processed in 30us (15527us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.899102:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00080000:0.0:1784186433.899245:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1784186433.961404:0:8284:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff8561080 20000000:00000080:0.0:1784186433.961420:0:8284:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b9fed986000 uarg=0000000000000000 20000000:01000000:0.0:1784186433.962903:0:8284:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1784186433.962907:0:8284:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1784186433.962909:0:8284:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784186433.962914:0:8284:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784186433.962919:0:8284:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1784186433.962946:0:8284:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784186433.962949:0:8284:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784186433.963153:0:8284:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784186433.963157:0:8284:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784186433.964354:0:8285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1784186433.964902:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1784186433.964970:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1784186433.965008:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1784186433.965020:0:8284:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784186433.965022:0:8284:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784186433.973600:0:8286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1784186433.974096:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1784186433.974149:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1784186433.974202:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1784186433.974217:0:8284:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784186433.974220:0:8284:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784186433.975156:0:8287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1784186433.976991:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1784186433.977048:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1784186433.977088:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1784186433.977105:0:8284:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784186433.977108:0:8284:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784186433.982175:0:8288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1784186433.982744:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1784186433.982817:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1784186433.982857:0:8284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1784186433.982874:0:8284:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784186433.982891:0:8284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.982920:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d18fe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18fdd expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.982928:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda505400/0x55bc3e8c99d1900e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19007 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.982934:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda504400/0x55bc3e8c99d19038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19031 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.982940:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda505c00/0x55bc3e8c99d19046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1903f expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.982946:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda505e00/0x55bc3e8c99d19054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1904d expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.982952:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda504200/0x55bc3e8c99d19070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19069 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.982959:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9ffdf17e00/0x55bc3e8c99d1909a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19093 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.982968:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9ffdf17000/0x55bc3e8c99d190a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576391 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.982976:0:8284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d190af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576398 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.982984:0:8284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.983032:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d190af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576398 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.983047:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d190af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576398 expref: 9 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186433.983063:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937929600:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186433.983166:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9ffdf17000/0x55bc3e8c99d190a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576391 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.983175:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9ffdf17000/0x55bc3e8c99d190a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576391 expref: 9 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186433.983184:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937929728:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186433.983214:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9ffdf17e00/0x55bc3e8c99d1909a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d19093 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.983223:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9ffdf17e00/0x55bc3e8c99d1909a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d19093 expref: 18 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186433.983232:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937929856:0@lo:104: 00000100:00100000:3.0:1784186433.983315:0:8284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784186433.983351:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda504200/0x55bc3e8c99d19070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d19069 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.983359:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fda504200/0x55bc3e8c99d19070 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d19069 expref: 18 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186433.983381:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937929984:0@lo:104: 00000100:00100000:3.0:1784186433.983407:0:8284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784186433.983464:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda505e00/0x55bc3e8c99d19054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d1904d expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.983474:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fda505e00/0x55bc3e8c99d19054 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d1904d expref: 18 pid: 5775 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186433.983483:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937930112:0@lo:104: 00010000:00010000:3.0:1784186433.983510:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda505c00/0x55bc3e8c99d19046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d1903f expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.983518:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fda505c00/0x55bc3e8c99d19046 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d1903f expref: 18 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186433.983526:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937930240:0@lo:104: 00010000:00010000:3.0:1784186433.983551:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda504400/0x55bc3e8c99d19038 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d19031 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.983559:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fda504400/0x55bc3e8c99d19038 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d19031 expref: 18 pid: 5774 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186433.983566:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937930368:0@lo:104: 00010000:00010000:3.0:1784186433.983588:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda505400/0x55bc3e8c99d1900e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d19007 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.983595:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fda505400/0x55bc3e8c99d1900e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d19007 expref: 18 pid: 5775 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186433.983615:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937930496:0@lo:104: 00010000:00010000:3.0:1784186433.983643:0:8284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d18fe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18fdd expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.983650:0:8284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d18fe4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18fdd expref: 18 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186433.983658:0:8284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937930624:0@lo:104: 00000100:00100000:3.0:1784186433.983674:0:8284:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784186433.983979:0:5765:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784186433.984001:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.984013:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.984020:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.984027:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.984048:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.984058:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937929856 00000100:00100000:0.0:1784186433.984066:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937929856 00000100:00100000:0.0:1784186433.984097:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937929984 00000100:00100000:0.0:1784186433.984100:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937929984 00000100:00100000:0.0:1784186433.984110:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937930112 00000100:00100000:0.0:1784186433.984113:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937930112 00000100:00100000:0.0:1784186433.984119:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937930240 00000100:00100000:0.0:1784186433.984121:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937930240 00000100:00100000:0.0:1784186433.984128:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937930368 00000100:00100000:0.0:1784186433.984130:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937930368 00000100:00100000:0.0:1784186433.984136:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937930496 00000100:00100000:0.0:1784186433.984138:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937930496 00000100:00100000:0.0:1784186433.984145:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937930624 00000100:00100000:0.0:1784186433.984147:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937930624 00000100:00100000:0.0:1784186433.984161:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784186433.984169:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+9:8284:x1870854937929856:12345-0@lo:104: 00010000:00010000:0.0:1784186433.984181:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984242:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784186433.984248:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+9:8284:x1870854937929856:12345-0@lo:104: Request processed in 81us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.984256:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784186433.984271:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784186433.984277:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec5b03850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+8:8284:x1870854937929984:12345-0@lo:104: 00010000:00010000:0.0:1784186433.984293:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984327:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784186433.984332:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec5b03850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+8:8284:x1870854937929984:12345-0@lo:104: Request processed in 56us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.984339:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784186433.984391:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784186433.984398:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+7:8284:x1870854937930112:12345-0@lo:104: 00010000:00010000:0.0:1784186433.984405:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984428:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784186433.984433:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+7:8284:x1870854937930112:12345-0@lo:104: Request processed in 36us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.984438:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784186433.984471:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784186433.984476:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+6:8284:x1870854937930240:12345-0@lo:104: 00010000:00010000:0.0:1784186433.984482:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984503:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1784186433.984507:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+6:8284:x1870854937930240:12345-0@lo:104: Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.984512:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784186433.984521:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784186433.984526:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+5:8284:x1870854937930368:12345-0@lo:104: 00010000:00010000:0.0:1784186433.984537:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984557:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1784186433.984562:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+5:8284:x1870854937930368:12345-0@lo:104: Request processed in 36us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.984567:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784186433.984576:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784186433.984581:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+4:8284:x1870854937930496:12345-0@lo:104: 00010000:00010000:0.0:1784186433.984586:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984604:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1784186433.984608:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+4:8284:x1870854937930496:12345-0@lo:104: Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.984613:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784186433.984622:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784186433.984627:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+3:8284:x1870854937930624:12345-0@lo:104: 00010000:00010000:0.0:1784186433.984633:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984656:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1784186433.984660:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+3:8284:x1870854937930624:12345-0@lo:104: Request processed in 33us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.984666:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1784186433.984683:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1784186433.984689:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984702:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27eda00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186433.984705:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984713:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186433.984720:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186433.984725:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186433.984765:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984772:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186433.984789:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984796:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d19093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1909a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984811:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1784186433.984814:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984820:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec200 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186433.984824:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984839:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186433.984845:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186433.984850:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186433.984864:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984869:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186433.984885:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984891:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec200/0x55bc3e8c99d19069 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19070 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984900:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784186433.984903:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984909:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17200 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186433.984911:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984916:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186433.984922:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186433.984933:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186433.984945:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984950:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186433.984955:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984961:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17200/0x55bc3e8c99d1904d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19054 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984969:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784186433.984972:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984977:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16000 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186433.984980:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.984986:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186433.984991:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186433.984996:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186433.985007:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985011:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186433.985023:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985029:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16000/0x55bc3e8c99d1903f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19046 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985038:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784186433.985040:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985045:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16e00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186433.985048:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985054:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186433.985060:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186433.985064:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186433.985077:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985082:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186433.985086:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985092:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16e00/0x55bc3e8c99d19031 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19038 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985101:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784186433.985109:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985114:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec800 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186433.985117:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985124:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186433.985130:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186433.985134:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186433.985147:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985153:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186433.985157:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985164:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ec800/0x55bc3e8c99d19007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1900e expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985172:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186433.985174:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985179:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186433.985182:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985199:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186433.985205:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186433.985210:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186433.985224:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985230:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186433.985233:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985238:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fda504800/0x55bc3e8c99d18fdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18fe4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985253:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186433.985255:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186433.985256:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186433.985265:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186433.985288:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937930752:0@lo:103: 00000100:00100000:0.0:1784186433.985332:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.985365:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937931264:0@lo:103: 00000100:00100000:0.0:1784186433.985384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.985404:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186433.985410:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937931136:0@lo:103: 00000100:00100000:0.0:1784186433.985430:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.985505:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937930880:0@lo:103: 00000100:00100000:0.0:1784186433.985527:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.985535:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937931392:0@lo:103: 00000100:00100000:0.0:1784186433.985568:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.985581:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784186433.985586:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937931008:0@lo:103: 00000100:00100000:0.0:1784186433.985605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.985615:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937931520:0@lo:103: 00000100:00100000:0.0:1784186433.985637:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186433.985664:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937930752 00000100:00100000:0.0:1784186433.985671:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937930752 00010000:00010000:0.0:1784186433.985698:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9ffdf17e00/0x55bc3e8c99d1909a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d19093 expref: 19 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186433.985715:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937931264 00000100:00100000:0.0:1784186433.985717:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937931264 00010000:00010000:0.0:1784186433.985727:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda504400/0x55bc3e8c99d19038 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d19031 expref: 20 pid: 5774 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186433.985750:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937931136 00000100:00100000:0.0:1784186433.985753:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937931136 00010000:00010000:0.0:1784186433.985764:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda505c00/0x55bc3e8c99d19046 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1903f expref: 21 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186433.985775:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937930880 00000100:00100000:0.0:1784186433.985777:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937930880 00010000:00010000:0.0:1784186433.985786:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda504200/0x55bc3e8c99d19070 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d19069 expref: 22 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186433.985795:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937931392 00000100:00100000:0.0:1784186433.985802:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937931392 00010000:00010000:0.0:1784186433.985814:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda505400/0x55bc3e8c99d1900e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d19007 expref: 23 pid: 5775 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186433.985825:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937931008 00000100:00100000:0.0:1784186433.985827:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937931008 00010000:00010000:0.0:1784186433.985835:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda505e00/0x55bc3e8c99d19054 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1904d expref: 24 pid: 5775 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186433.985844:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937931520 00000100:00100000:0.0:1784186433.985846:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937931520 00010000:00010000:0.0:1784186433.985854:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d18fe4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18fdd expref: 25 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186433.985866:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784186433.985873:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+25:3307:x1870854937930752:12345-0@lo:103: 00010000:00010000:0.0:1784186433.985885:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186433.985889:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9ffdf17e00/0x55bc3e8c99d1909a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d19093 expref: 25 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985898:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9ffdf17e00/0x55bc3e8c99d1909a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d19093 expref: 25 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985914:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186433.985944:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+25:3307:x1870854937930752:12345-0@lo:103: Request processed in 72us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.985952:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784186433.985968:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784186433.985973:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+24:3307:x1870854937931264:12345-0@lo:103: 00010000:00010000:0.0:1784186433.985981:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186433.985990:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda504400/0x55bc3e8c99d19038 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d19031 expref: 24 pid: 5774 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.985999:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda504400/0x55bc3e8c99d19038 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d19031 expref: 24 pid: 5774 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.986009:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186433.986030:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+24:3307:x1870854937931264:12345-0@lo:103: Request processed in 57us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.986037:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784186433.986049:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784186433.986055:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+23:3307:x1870854937931136:12345-0@lo:103: 00010000:00010000:0.0:1784186433.986062:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186433.986066:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda505c00/0x55bc3e8c99d19046 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1903f expref: 23 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.986074:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda505c00/0x55bc3e8c99d19046 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d1903f expref: 23 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.986082:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186433.986103:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+23:3307:x1870854937931136:12345-0@lo:103: Request processed in 49us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.986109:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784186433.986121:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784186433.986127:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+22:3308:x1870854937930880:12345-0@lo:103: 00010000:00010000:0.0:1784186433.986134:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186433.986137:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda504200/0x55bc3e8c99d19070 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d19069 expref: 22 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.986154:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda504200/0x55bc3e8c99d19070 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d19069 expref: 22 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.986164:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186433.986191:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+22:3308:x1870854937930880:12345-0@lo:103: Request processed in 64us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.986197:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784186433.986212:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784186433.986217:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+21:3308:x1870854937931392:12345-0@lo:103: 00010000:00010000:0.0:1784186433.986224:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186433.986228:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda505400/0x55bc3e8c99d1900e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d19007 expref: 21 pid: 5775 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.986235:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda505400/0x55bc3e8c99d1900e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d19007 expref: 21 pid: 5775 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.986244:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186433.986262:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+21:3308:x1870854937931392:12345-0@lo:103: Request processed in 45us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.986268:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784186433.986279:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784186433.986285:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+20:3308:x1870854937931008:12345-0@lo:103: 00010000:00010000:0.0:1784186433.986292:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186433.986296:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda505e00/0x55bc3e8c99d19054 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1904d expref: 20 pid: 5775 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.986304:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda505e00/0x55bc3e8c99d19054 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d1904d expref: 20 pid: 5775 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.986320:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186433.986344:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+20:3308:x1870854937931008:12345-0@lo:103: Request processed in 59us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.986350:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784186433.986361:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784186433.986367:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe55b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937931520:12345-0@lo:103: 00010000:00010000:0.0:1784186433.986374:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186433.986378:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d18fe4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18fdd expref: 19 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.986386:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d18fe4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18fdd expref: 19 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186433.986394:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186433.986413:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe55b2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937931520:12345-0@lo:103: Request processed in 47us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186433.986419:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784186433.986503:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937931008:0@lo:103: 00000100:00100000:0.0:1784186433.986512:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937931520:0@lo:103: 00000100:00100000:0.0:1784186433.986518:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937930880:0@lo:103: 00000100:00100000:0.0:1784186433.986524:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937931392:0@lo:103: 00000100:00100000:0.0:1784186433.986551:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937931136:0@lo:103: 00000100:00100000:0.0:1784186433.986558:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937930752:0@lo:103: 00000100:00100000:0.0:1784186433.986564:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937931264:0@lo:103: 00010000:00010000:1.0:1784186433.986987:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf17e00/0x55bc3e8c99d1909a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d19093 expref: 18 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186433.987012:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937929856:0@lo:104: 00010000:00010000:1.0:1784186433.987027:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda504200/0x55bc3e8c99d19070 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d19069 expref: 17 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186433.987034:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937929984:0@lo:104: 00010000:00010000:1.0:1784186433.987043:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda505e00/0x55bc3e8c99d19054 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d1904d expref: 16 pid: 5775 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186433.987050:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937930112:0@lo:104: 00010000:00010000:1.0:1784186433.987060:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda505c00/0x55bc3e8c99d19046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d1903f expref: 15 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186433.987068:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937930240:0@lo:104: 00010000:00010000:1.0:1784186433.987078:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda504400/0x55bc3e8c99d19038 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d19031 expref: 14 pid: 5774 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186433.987085:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937930368:0@lo:104: 00010000:00010000:1.0:1784186433.987092:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda505400/0x55bc3e8c99d1900e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d19007 expref: 13 pid: 5775 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186433.987100:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937930496:0@lo:104: 00010000:00010000:1.0:1784186433.987107:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d18fe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18fdd expref: 12 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186433.987117:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937930624:0@lo:104: 00000100:00100000:1.0:1784186433.991297:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937929600:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186433.995165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186433.995258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186433.995353:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915887744 00000100:00100000:3.0:1784186433.995364:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915887744 00010000:00010000:3.0:1784186433.995407:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d190af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576398 expref: 10 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186433.995463:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915887872 00000100:00100000:3.0:1784186433.995467:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915887872 00010000:00010000:3.0:1784186433.995483:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9ffdf17000/0x55bc3e8c99d190a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576391 expref: 11 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186433.995499:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:3.0:1784186433.995507:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:2356:x1870854915887744:12345-192.168.201.31@tcp:103: 00010000:00010000:3.0:1784186433.995522:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186433.995528:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d190af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576398 expref: 11 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995540:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d190af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576398 expref: 11 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995578:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d190af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576398 expref: 11 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995594:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186433.995647:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2356:x1870854915887744:12345-192.168.201.31@tcp:103: Request processed in 140us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186433.995654:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:3.0:1784186433.995671:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:3.0:1784186433.995678:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:2356:x1870854915887872:12345-192.168.201.31@tcp:103: 00010000:00010000:3.0:1784186433.995687:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186433.995692:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9ffdf17000/0x55bc3e8c99d190a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576391 expref: 9 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995701:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9ffdf17000/0x55bc3e8c99d190a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576391 expref: 9 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995714:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995722:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995745:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995752:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995759:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995772:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995778:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17c00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186433.995782:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995791:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995800:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186433.995810:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186433.995838:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:2356:x1870854915887872:12345-192.168.201.31@tcp:103: Request processed in 159us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186433.995844:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00010000:00010000:1.0:1784186433.996994:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf17000/0x55bc3e8c99d190a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576391 expref: 8 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186433.997012:0:8284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8284:1870854937929728:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186433.997058:0:8284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186433.997067:0:8284:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186433.997073:0:8284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186433.997079:0:8284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d190e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186434.621624:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186434.751829:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937931648:0@lo:13: 00000100:00100000:0.0:1784186434.751938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186434.752567:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937931648 00000100:00100000:2.0:1784186434.752575:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937931648 00000100:00100000:2.0:1784186434.752652:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784186434.752662:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937931648:12345-0@lo:13: 00002000:00000024:2.0:1784186434.752710:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186434.753344:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937931648:12345-0@lo:13: Request processed in 681us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186434.753381:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1784186434.753667:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784186434.756525:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe87c700 x1870854937931648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186434.756559:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937931648:0@lo:13: 00010000:00010000:0.0:1784186435.645642:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186435.773876:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937931776:0@lo:400: 00000100:00100000:1.0:1784186435.773962:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186435.774032:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854937932288:0@lo:400: 00000100:00100000:1.0:1784186435.774103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186435.774133:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784186435.774139:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937932160:0@lo:400: 00000100:00100000:1.0:1784186435.774164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186435.774196:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937932288 00000100:00100000:1.0:1784186435.774203:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937932288 00000100:00100000:1.0:1784186435.774261:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784186435.774269:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1870854937932288:12345-0@lo:400: 00000100:00100000:1.0:1784186435.774320:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1870854937932288:12345-0@lo:400: Request processed in 52us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186435.774359:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784186435.774388:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937932160 00000100:00100000:1.0:1784186435.774391:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937932160 00000100:00100000:1.0:1784186435.774413:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784186435.774420:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937932160:12345-0@lo:400: 00000100:00100000:1.0:1784186435.774477:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937932160:12345-0@lo:400: Request processed in 58us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186435.774483:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1784186435.774506:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784186435.774533:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5578000 x1870854937932160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186435.774548:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937932160:0@lo:400: 00000100:00100000:1.0:1784186435.774560:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854937932288:0@lo:400: 00000100:00100000:3.0:1784186435.774641:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937931776 00000100:00100000:3.0:1784186435.774645:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937931776 00000100:00100000:3.0:1784186435.774679:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784186435.774687:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3307:x1870854937931776:12345-0@lo:400: 00000100:00100000:3.0:1784186435.774739:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+12:3307:x1870854937931776:12345-0@lo:400: Request processed in 53us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186435.774745:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784186435.774788:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937931776:0@lo:400: 00000100:00100000:0.0:1784186435.775293:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854937932032:0@lo:400: 00000100:00100000:0.0:1784186435.775355:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186435.775389:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784186435.775394:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937931904:0@lo:400: 00000100:00100000:0.0:1784186435.775417:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186435.775477:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937932416:0@lo:400: 00000100:00100000:0.0:1784186435.775503:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186435.775531:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937932416 00000100:00100000:0.0:1784186435.775535:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937932416 00000100:00100000:0.0:1784186435.775572:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784186435.775579:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937932416:12345-0@lo:400: 00000100:00100000:0.0:1784186435.775620:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937932416:12345-0@lo:400: Request processed in 41us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186435.775626:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1784186435.775644:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784186435.775669:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe557a680 x1870854937932416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186435.775681:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937932416:0@lo:400: 00000100:00100000:3.0:1784186435.775759:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937932032 00000100:00100000:3.0:1784186435.775764:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937932032 00000100:00100000:3.0:1784186435.775802:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937931904 00000100:00100000:3.0:1784186435.775805:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937931904 00000100:00100000:3.0:1784186435.775823:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784186435.775830:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854937932032:12345-0@lo:400: 00000100:00100000:3.0:1784186435.775865:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854937932032:12345-0@lo:400: Request processed in 36us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186435.775871:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784186435.775882:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784186435.775888:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937931904:12345-0@lo:400: 00000100:00100000:3.0:1784186435.775912:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937931904:12345-0@lo:400: Request processed in 24us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186435.775918:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1784186435.778240:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186435.778326:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937931904:0@lo:400: 00000100:00100000:0.0:1784186435.778354:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854937932032:0@lo:400: 10000000:01000000:0.0:1784186435.965575:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784186435.965584:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9fc9c79000 from 39 10000000:01000000:0.0:1784186435.965590:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784186435.965638:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186435.965650:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186435.965662:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186435.965687:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937932544:0@lo:101: 00000100:00100000:0.0:1784186435.965772:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186435.965922:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808600 going to sleep for 11 seconds 00000100:00100000:1.0:1784186435.981045:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937932544 00000100:00100000:1.0:1784186435.981061:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937932544 00000100:00100000:1.0:1784186435.981132:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784186435.981142:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+12:5780:x1870854937932544:12345-0@lo:101: 00010000:00010000:1.0:1784186435.981159:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186435.981178:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d190f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d190ee expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186435.981205:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d190f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d190ee expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186435.981216:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d190f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d190ee expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186435.981243:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ed000, rc 0) 00000100:00100000:1.0:1784186435.981320:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937932544:12345-0@lo:101: Request processed in 180us (15549us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186435.981327:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1784186435.982095:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937932544:0@lo:101: 00010000:00010000:0.0:1784186435.982118:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186435.982129:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186435.982195:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937932672:0@lo:501: 00000100:00100000:0.0:1784186435.982232:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186435.982272:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808600 going to sleep for 11 seconds 00000100:00100000:1.0:1784186435.982332:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937932672 00000100:00100000:1.0:1784186435.982338:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937932672 00000100:00100000:1.0:1784186435.982369:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784186435.982376:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937932672:12345-0@lo:501: 00000100:00100000:1.0:1784186435.982686:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937932672:12345-0@lo:501: Request processed in 309us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186435.982693:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784186435.982793:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937932672:0@lo:501: 00000100:00100000:0.0:1784186435.982828:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937932800:0@lo:503: 00000100:00100000:0.0:1784186435.983028:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186435.983054:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808600 going to sleep for 11 seconds 00000100:00100000:1.0:1784186435.983106:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937932800 00000100:00100000:1.0:1784186435.983110:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937932800 00000100:00100000:1.0:1784186435.983140:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784186435.983147:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937932800:12345-0@lo:503: 00000100:00100000:1.0:1784186435.983300:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937932800:12345-0@lo:503: Request processed in 153us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186435.983307:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784186435.989885:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937932800:0@lo:503: 00000100:00100000:0.0:1784186435.992841:0:8300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8300:1870854937932928:0@lo:502: 00000100:00100000:0.0:1784186435.992942:0:8300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186435.993110:0:8300:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186435.993974:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937932928 00000100:00100000:1.0:1784186435.993999:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937932928 00000100:00100000:1.0:1784186435.994196:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784186435.994209:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+13:8300:x1870854937932928:12345-0@lo:502: 00000100:00100000:2.0:1784186435.994810:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+13:8300:x1870854937932928:12345-0@lo:502: Request processed in 597us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186435.994819:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784186435.994957:0:8300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8300:1870854937932928:0@lo:502: 00000100:00100000:0.0:1784186435.995151:0:8300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8300:1870854937933056:0@lo:502: 00000100:00100000:0.0:1784186435.995191:0:8300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186435.995221:0:8300:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186435.995277:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937933056 00000100:00100000:3.0:1784186435.995281:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937933056 00000100:00100000:3.0:1784186435.995312:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784186435.995319:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:8300:x1870854937933056:12345-0@lo:502: 00000100:00100000:3.0:1784186435.995501:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+13:8300:x1870854937933056:12345-0@lo:502: Request processed in 181us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186435.995508:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784186435.996126:0:8300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8300:1870854937933056:0@lo:502: 00000040:00080000:2.0:1784186435.996151:0:8300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1784186435.996304:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1784186435.996319:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784186435.996328:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186435.996339:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186435.996357:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784186435.996359:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1784186435.996362:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784186435.996387:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186435.996394:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186435.996403:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186435.996416:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937933184:0@lo:101: 00000100:00100000:3.0:1784186435.996488:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186435.996517:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784186435.997941:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937933184 00000100:00100000:0.0:1784186435.997952:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937933184 00000100:00100000:0.0:1784186435.998002:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784186435.998017:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+13:5780:x1870854937933184:12345-0@lo:101: 00010000:00010000:0.0:1784186435.998030:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186435.998048:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9129200/0x55bc3e8c99d19103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d190fc expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186435.998073:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9129200/0x55bc3e8c99d19103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d190fc expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186435.998083:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9129200/0x55bc3e8c99d19103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d190fc expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186435.998092:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129200, rc 0) 00000100:00100000:0.0:1784186435.998176:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937933184:12345-0@lo:101: Request processed in 160us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186435.998183:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784186436.000399:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937933184:0@lo:101: 00010000:00010000:3.0:1784186436.000427:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.000465:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186436.000544:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937933312:0@lo:501: 00000100:00100000:3.0:1784186436.000675:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.000729:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186436.000791:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937933312 00000100:00100000:1.0:1784186436.000798:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937933312 00000100:00100000:1.0:1784186436.000837:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784186436.000845:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937933312:12345-0@lo:501: 00000100:00100000:1.0:1784186436.001143:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937933312:12345-0@lo:501: Request processed in 298us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186436.001152:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784186436.002746:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937933312:0@lo:501: 00000100:00100000:3.0:1784186436.002803:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937933440:0@lo:503: 00000100:00100000:3.0:1784186436.002878:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.002924:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186436.006871:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937933440 00000100:00100000:1.0:1784186436.006885:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937933440 00000100:00100000:1.0:1784186436.006951:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784186436.006960:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937933440:12345-0@lo:503: 00000100:00100000:1.0:1784186436.007229:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937933440:12345-0@lo:503: Request processed in 268us (4349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186436.007237:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784186436.009138:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937933440:0@lo:503: 00000100:00100000:0.0:1784186436.010408:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8301:1870854937933568:0@lo:502: 00000100:00100000:0.0:1784186436.010537:0:8301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186436.010687:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937933568 00000100:00100000:2.0:1784186436.010695:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937933568 00000100:00100000:2.0:1784186436.010744:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784186436.010752:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+14:8301:x1870854937933568:12345-0@lo:502: 00000100:00100000:2.0:1784186436.010951:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+14:8301:x1870854937933568:12345-0@lo:502: Request processed in 199us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186436.010958:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784186436.011217:0:8301:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808900 going to sleep for 11 seconds 00000100:00100000:0.0:1784186436.011239:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8301:1870854937933568:0@lo:502: 00000020:01000000:0.0:1784186436.011266:0:8301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186436.011275:0:8301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186436.011277:0:8301:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784186436.011283:0:8301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784186436.011307:0:8301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8301:1870854937933696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186436.011424:0:8301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186436.011473:0:8301:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1808900 going to sleep for 11 seconds 00000100:00100000:2.0:1784186436.011554:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937933696 00000100:00100000:2.0:1784186436.011558:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937933696 00000100:00100000:2.0:1784186436.011593:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784186436.011607:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:8301:x1870854937933696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784186436.011749:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+14:8301:x1870854937933696:12345-0@lo:502:llog_process_th.0 Request processed in 142us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186436.011757:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784186436.011942:0:8301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8301:1870854937933696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186436.011962:0:8301:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186436.011967:0:8301:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186436.011969:0:8301:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784186436.011973:0:8301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1784186436.020247:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1784186436.020282:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784186436.020300:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.020311:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186436.020322:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784186436.020325:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9ffef01800 from 39 10000000:01000000:3.0:1784186436.020328:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784186436.020776:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.020786:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.020799:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186436.020826:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937933824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.020896:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.020941:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186436.021000:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937933824 00000100:00100000:1.0:1784186436.021017:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937933824 00000100:00100000:1.0:1784186436.021068:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784186436.021078:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:5780:x1870854937933824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784186436.021091:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186436.021105:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc27ec600/0x55bc3e8c99d19111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1910a expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186436.021127:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27ec600/0x55bc3e8c99d19111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1910a expref: 15 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186436.021139:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc27ec600/0x55bc3e8c99d19111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1910a expref: 15 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186436.021148:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ec600, rc 0) 00000100:00100000:1.0:1784186436.021193:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937933824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186436.021200:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784186436.023200:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937933824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784186436.023230:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.023257:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186436.023332:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937933952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.023394:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.023437:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1784186436.023585:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937933952 00000100:00100000:0.0:1784186436.023591:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937933952 00000100:00100000:0.0:1784186436.023628:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784186436.023636:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937933952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186436.023905:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937933952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186436.023912:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784186436.024254:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937933952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.024284:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937934080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.024323:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.024360:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784186436.025048:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937934080 00000100:00100000:2.0:1784186436.025057:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937934080 00000100:00100000:2.0:1784186436.025104:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784186436.025114:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937934080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784186436.025321:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937934080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186436.025331:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784186436.029908:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937934080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186436.031019:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8302:1870854937934208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186436.031101:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186436.031146:0:8302:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd18083c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186436.032549:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937934208 00000100:00100000:1.0:1784186436.032575:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937934208 00000100:00100000:1.0:1784186436.032650:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784186436.032660:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:8302:x1870854937934208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784186436.032974:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+15:8302:x1870854937934208:12345-0@lo:502:llog_process_th.0 Request processed in 315us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186436.032982:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784186436.034549:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8302:1870854937934208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186436.034635:0:8302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8302:1870854937934336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186436.034711:0:8302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186436.034754:0:8302:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd18083c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186436.035975:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937934336 00000100:00100000:2.0:1784186436.035986:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937934336 00000100:00100000:2.0:1784186436.036040:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784186436.036055:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:8302:x1870854937934336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784186436.036343:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+15:8302:x1870854937934336:12345-0@lo:502:llog_process_th.0 Request processed in 289us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186436.036350:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784186436.036397:0:8302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8302:1870854937934336:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784186436.036427:0:8302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784186436.036687:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1784186436.036719:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784186436.036730:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186436.036740:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186436.036750:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784186436.036760:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1784186436.036763:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784186436.036795:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186436.036803:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186436.036812:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186436.036831:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937934464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784186436.036870:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186436.036907:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd199bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.036957:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937934464 00000100:00100000:3.0:1784186436.036963:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937934464 00000100:00100000:3.0:1784186436.036997:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784186436.037005:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+15:5780:x1870854937934464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784186436.037014:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186436.037029:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d1911f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d19118 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.037051:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d1911f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d19118 expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.037060:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d1911f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19118 expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.037075:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17a00, rc 0) 00000100:00100000:3.0:1784186436.037113:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937934464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.037118:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784186436.037150:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937934464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784186436.037162:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.037170:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186436.037213:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937934592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.037238:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.037251:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.037262:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937934592 00000100:00100000:3.0:1784186436.037265:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937934592 00000100:00100000:3.0:1784186436.037281:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784186436.037286:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937934592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.037542:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937934592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.037549:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784186436.037593:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937934592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.037620:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937934720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.037656:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.037675:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.037687:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937934720 00000100:00100000:3.0:1784186436.037691:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937934720 00000100:00100000:3.0:1784186436.037721:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784186436.037728:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937934720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.037866:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937934720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.037873:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784186436.037907:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937934720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.038080:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8303:1870854937934848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186436.038113:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.038130:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937934848 00000100:00100000:3.0:1784186436.038134:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937934848 00000100:00100000:3.0:1784186436.038150:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784186436.038157:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:8303:x1870854937934848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186436.038270:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:8303:x1870854937934848:12345-0@lo:502:llog_process_th.0 Request processed in 113us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.038277:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784186436.038303:0:8303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.038315:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8303:1870854937934848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784186436.038335:0:8303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784186436.038345:0:8303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186436.038347:0:8303:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784186436.038354:0:8303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784186436.038373:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8303:1870854937934976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186436.038404:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.038428:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937934976 00000100:00100000:3.0:1784186436.038431:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937934976 00000100:00100000:3.0:1784186436.038473:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784186436.038479:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:8303:x1870854937934976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186436.038582:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:8303:x1870854937934976:12345-0@lo:502:llog_process_th.0 Request processed in 102us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.038589:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784186436.038617:0:8303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.038629:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8303:1870854937934976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784186436.038645:0:8303:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186436.038649:0:8303:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186436.038651:0:8303:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784186436.038655:0:8303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1784186436.038694:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1784186436.038725:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784186436.038734:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.038744:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186436.038752:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784186436.038755:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9fc5f8f800 from 39 10000000:01000000:3.0:1784186436.038758:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784186436.038779:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.038788:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.038809:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186436.038823:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937935104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.038849:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.038862:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.038873:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937935104 00000100:00100000:3.0:1784186436.038876:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937935104 00000100:00100000:3.0:1784186436.038893:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784186436.038899:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937935104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784186436.038907:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186436.038917:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf16400/0x55bc3e8c99d1912d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d19126 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.038937:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf16400/0x55bc3e8c99d1912d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d19126 expref: 17 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.038947:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf16400/0x55bc3e8c99d1912d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19126 expref: 17 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.038955:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf16400, rc 0) 00000100:00100000:3.0:1784186436.038985:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937935104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.038991:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784186436.039017:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937935104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784186436.039028:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.039042:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186436.039082:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937935232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.039104:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.039116:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.039126:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937935232 00000100:00100000:3.0:1784186436.039129:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937935232 00000100:00100000:3.0:1784186436.039144:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784186436.039149:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937935232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.039344:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937935232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.039350:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784186436.039378:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937935232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.039402:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937935360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.039434:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.039474:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.039487:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937935360 00000100:00100000:3.0:1784186436.039490:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937935360 00000100:00100000:3.0:1784186436.039505:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784186436.039511:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937935360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.039634:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937935360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.039641:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784186436.039680:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937935360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.039900:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8304:1870854937935488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186436.039933:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.039951:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937935488 00000100:00100000:3.0:1784186436.039954:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937935488 00000100:00100000:3.0:1784186436.039968:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784186436.039973:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:8304:x1870854937935488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186436.040116:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:8304:x1870854937935488:12345-0@lo:502:llog_process_th.0 Request processed in 141us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.040122:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784186436.040166:0:8304:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.040180:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8304:1870854937935488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186436.040216:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8304:1870854937935616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186436.040245:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.040263:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937935616 00000100:00100000:3.0:1784186436.040266:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937935616 00000100:00100000:3.0:1784186436.040282:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784186436.040287:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:8304:x1870854937935616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186436.040403:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:8304:x1870854937935616:12345-0@lo:502:llog_process_th.0 Request processed in 115us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.040409:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784186436.040434:0:8304:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb245a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.040470:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8304:1870854937935616:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784186436.040487:0:8304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1784186436.040530:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1784186436.040542:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784186436.040549:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.040558:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186436.040565:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784186436.040567:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1784186436.040570:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784186436.040589:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.040596:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.040605:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186436.040616:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937935744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.040639:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.040650:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb245a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.040660:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937935744 00000100:00100000:3.0:1784186436.040663:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937935744 00000100:00100000:3.0:1784186436.040678:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784186436.040683:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937935744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784186436.040690:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186436.041166:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1913b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d19134 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.041262:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1913b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d19134 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.041272:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1913b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19134 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.041280:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17600, rc 0) 00000100:00100000:3.0:1784186436.041493:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937935744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 808us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.041500:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784186436.042549:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937935744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784186436.042761:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186436.042774:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186436.042845:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937935872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784186436.042897:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186436.042936:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd199bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784186436.043187:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937935872 00000100:00100000:0.0:1784186436.043194:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937935872 00000100:00100000:0.0:1784186436.043241:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784186436.043250:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937935872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186436.043628:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937935872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 378us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186436.043635:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784186436.045532:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937935872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784186436.045617:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937936000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784186436.045710:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186436.045757:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd199bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784186436.046201:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937936000 00000100:00100000:3.0:1784186436.046209:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937936000 00000100:00100000:3.0:1784186436.046262:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784186436.046270:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937936000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.046532:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937936000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 261us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186436.046539:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784186436.046872:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937936000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784186436.047217:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8305:1870854937936128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784186436.047268:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186436.047305:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd199bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186436.047484:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937936128 00000100:00100000:1.0:1784186436.047491:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937936128 00000100:00100000:1.0:1784186436.047523:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784186436.047530:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:8305:x1870854937936128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784186436.047763:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:8305:x1870854937936128:12345-0@lo:502:llog_process_th.0 Request processed in 231us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186436.047771:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784186436.047995:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8305:1870854937936128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784186436.048023:0:8305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186436.048032:0:8305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186436.048035:0:8305:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784186436.048040:0:8305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784186436.048062:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8305:1870854937936256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784186436.048098:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186436.048116:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb245a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186436.048499:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937936256 00000100:00100000:1.0:1784186436.048505:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937936256 00000100:00100000:1.0:1784186436.048532:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784186436.048540:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:8305:x1870854937936256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784186436.048813:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:8305:x1870854937936256:12345-0@lo:502:llog_process_th.0 Request processed in 273us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186436.048820:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1784186436.050359:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8305:1870854937936256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186436.050404:0:8305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186436.050423:0:8305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186436.050425:0:8305:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784186436.050431:0:8305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1784186436.050601:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1784186436.050620:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784186436.050632:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.050643:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186436.050657:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784186436.050660:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b9fc7763380 from 1 10000000:01000000:3.0:1784186436.050712:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784186436.050744:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16c00/0x55bc3e8c99d19142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.050752:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16c00/0x55bc3e8c99d19142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.050759:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16c00/0x55bc3e8c99d19142 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186436.050773:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937936384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.050819:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.050852:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58180 going to sleep for 11 seconds 00000100:00100000:0.0:1784186436.050858:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937936384 00000100:00100000:0.0:1784186436.050864:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937936384 00000100:00100000:0.0:1784186436.050954:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784186436.050964:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937936384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186436.050976:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186436.050989:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9129e00/0x55bc3e8c99d19149 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d19142 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186436.051038:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9129e00/0x55bc3e8c99d19149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d19142 expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186436.051049:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9129e00/0x55bc3e8c99d19149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19142 expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186436.051057:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129e00, rc 0) 00000100:00100000:0.0:1784186436.051109:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937936384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186436.051116:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784186436.051181:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937936384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784186436.051195:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16c00/0x55bc3e8c99d19142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19149 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.051204:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16c00/0x55bc3e8c99d19142 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19149 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186436.051254:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5579f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937936512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186436.051280:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186436.051552:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58180 going to sleep for 11 seconds 00000100:00100000:1.0:1784186436.051665:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937936512 00000100:00100000:1.0:1784186436.051671:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937936512 00000100:00100000:1.0:1784186436.051693:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784186436.051712:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937936512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784186436.051961:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937936512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (679us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784186436.051976:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784186436.052130:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5579f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937936512:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784186436.052156:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784186436.052164:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16c00/0x55bc3e8c99d19142 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19149 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186436.052182:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16c00/0x55bc3e8c99d19142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19149 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186436.286796:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784186436.286821:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937936640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784186436.286892:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186436.292067:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937936640 00000100:00100000:1.0:1784186436.292082:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937936640 00000100:00100000:1.0:1784186436.292156:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784186436.292166:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937936640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784186436.292212:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186436.293888:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937936640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1715us (6988us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186436.293902:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1784186436.295845:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c58000 x1870854937936640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186436.295872:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937936640:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784186436.669640:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186436.818881:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186436.819048:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915888000 00000100:00100000:1.0:1784186436.819057:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915888000 00000100:00100000:1.0:1784186436.819117:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:1.0:1784186436.819126:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+8:5572:x1870854915888000:12345-192.168.201.31@tcp:101: 00010000:00010000:1.0:1784186436.819142:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186436.819173:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d19150 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5763fa expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186436.819203:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d19150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763fa expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186436.819215:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d19150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763fa expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186436.819225:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ec800, rc 0) 00000100:00100000:1.0:1784186436.819290:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:5572:x1870854915888000:12345-192.168.201.31@tcp:101: Request processed in 164us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186436.819297:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:3.0:1784186436.823241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186436.823382:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915888128 00000100:00100000:2.0:1784186436.823391:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915888128 00000100:00100000:2.0:1784186436.823471:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:2.0:1784186436.823480:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:5572:x1870854915888128:12345-192.168.201.31@tcp:501: 00000100:00100000:2.0:1784186436.823957:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:5572:x1870854915888128:12345-192.168.201.31@tcp:501: Request processed in 476us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186436.823966:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:3.0:1784186436.826323:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186436.826415:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915888256 00000100:00100000:0.0:1784186436.826424:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915888256 00000100:00100000:0.0:1784186436.826509:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 167 00000100:00100000:0.0:1784186436.826520:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:5572:x1870854915888256:12345-192.168.201.31@tcp:503: 00000100:00100000:0.0:1784186436.827603:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:5572:x1870854915888256:12345-192.168.201.31@tcp:503: Request processed in 244us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186436.827619:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 167 00000100:00100000:3.0:1784186436.831321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186436.836506:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915888384 00000100:00100000:1.0:1784186436.836523:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915888384 00000100:00100000:1.0:1784186436.837995:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 168 00000100:00100000:1.0:1784186436.838013:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:6050:x1870854915888384:12345-192.168.201.31@tcp:502: 00000100:00100000:1.0:1784186436.838281:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:6050:x1870854915888384:12345-192.168.201.31@tcp:502: Request processed in 274us (6970us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186436.838289:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 168 00000100:00100000:3.0:1784186436.843202:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186436.856306:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915888512 00000100:00100000:2.0:1784186436.856360:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915888512 00000100:00100000:1.0:1784186436.856583:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 169 00000100:00100000:1.0:1784186436.856597:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:6050:x1870854915888512:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784186436.857268:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:6050:x1870854915888512:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 672us (14076us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186436.857278:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 169 00000100:00100000:3.0:1784186436.862541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186436.862609:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915888640 00000100:00100000:1.0:1784186436.862620:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915888640 00000100:00100000:1.0:1784186436.862673:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 170 00000100:00100000:1.0:1784186436.862682:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:5572:x1870854915888640:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784186436.862715:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186436.862736:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc27ec200/0x55bc3e8c99d19157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576401 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186436.862766:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27ec200/0x55bc3e8c99d19157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576401 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186436.862776:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc27ec200/0x55bc3e8c99d19157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576401 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186436.862783:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ec200, rc 0) 00000100:00100000:1.0:1784186436.863003:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5572:x1870854915888640:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 321us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186436.863009:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 170 00000100:00100000:3.0:1784186436.868594:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186436.868681:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915888768 00000100:00100000:2.0:1784186436.868704:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915888768 00000100:00100000:2.0:1784186436.868758:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 171 00000100:00100000:2.0:1784186436.868764:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5572:x1870854915888768:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784186436.869159:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5572:x1870854915888768:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 392us (574us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784186436.869167:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 171 00010000:00010000:0.0:1784186437.693692:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784186438.533477:0:8344:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe993c5220 20000000:00000080:3.0:1784186438.533496:0:8344:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b9ec670ac00 uarg=0000000000000000 20000000:01000000:3.0:1784186438.533531:0:8344:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784186438.533538:0:8344:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784186438.533544:0:8344:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784186438.539263:0:8345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1784186438.539405:0:8344:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1784186438.547515:0:8344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1784186438.547587:0:8344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1784186438.547654:0:8344:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1784186438.547680:0:8344:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784186438.547699:0:8344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.547716:0:8344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d18ed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18ecc expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.547725:0:8344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc27eca00/0x55bc3e8c99d18f35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18f2e expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.547733:0:8344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d19000 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d18ff9 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.547749:0:8344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc9128400/0x55bc3e8c99d190bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c9 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.547756:0:8344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.547799:0:8344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc9128400/0x55bc3e8c99d190bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c9 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.547832:0:8344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9fc9128400/0x55bc3e8c99d190bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c9 expref: 9 pid: 5777 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186438.547847:0:8344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8344:1870854937936768:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186438.547970:0:8344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d19000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18ff9 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.547978:0:8344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d19000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18ff9 expref: 18 pid: 5775 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186438.547987:0:8344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8344:1870854937936896:0@lo:104: 00000100:00100000:2.0:1784186438.548026:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784186438.548055:0:8344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc27eca00/0x55bc3e8c99d18f35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18f2e expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.548063:0:8344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fc27eca00/0x55bc3e8c99d18f35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f2e expref: 18 pid: 5777 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186438.548071:0:8344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8344:1870854937937024:0@lo:104: 00000100:00100000:2.0:1784186438.548092:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186438.548125:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784186438.548136:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937936896 00000100:00100000:2.0:1784186438.548142:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937936896 00000100:00100000:2.0:1784186438.548176:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937937024 00000100:00100000:2.0:1784186438.548179:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937937024 00000100:00100000:2.0:1784186438.548195:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784186438.548205:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+4:8344:x1870854937936896:12345-0@lo:104: 00010000:00010000:2.0:1784186438.548216:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.548266:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784186438.548272:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+4:8344:x1870854937936896:12345-0@lo:104: Request processed in 69us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186438.548281:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784186438.548300:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784186438.548306:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe04dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:8344:x1870854937937024:12345-0@lo:104: 00010000:00010000:2.0:1784186438.548315:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.548341:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784186438.548346:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe04dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:8344:x1870854937937024:12345-0@lo:104: Request processed in 41us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186438.548351:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1784186438.548396:0:8344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d18ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d18ecc expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.548405:0:8344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d18ed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d18ecc expref: 18 pid: 5774 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186438.548413:0:8344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8344:1870854937937152:0@lo:104: 00000100:00100000:2.0:1784186438.548433:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186438.548472:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937937152 00000100:00100000:2.0:1784186438.548475:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937937152 00000100:00100000:2.0:1784186438.548492:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784186438.548497:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:8344:x1870854937937152:12345-0@lo:104: 00010000:00010000:2.0:1784186438.548505:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fca861a00/0x55bc3e8c99d18ecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186438.548542:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784186438.548547:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:8344:x1870854937937152:12345-0@lo:104: Request processed in 50us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186438.548553:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784186438.548572:0:8344:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21e000 going to sleep for 11 seconds 00000100:00100000:2.0:1784186438.548594:0:8344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8344:1870854937936896:0@lo:104: 00000100:00100000:2.0:1784186438.548602:0:8344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8344:1870854937937024:0@lo:104: 00000100:00100000:2.0:1784186438.548609:0:8344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8344:1870854937937152:0@lo:104: 00010000:00010000:0.0:1784186438.549290:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784186438.549297:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549317:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128e00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186438.549321:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549330:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186438.549337:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186438.549343:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784186438.549381:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549389:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186438.549406:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549413:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128e00/0x55bc3e8c99d18ff9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19000 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549427:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784186438.549431:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549437:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505600 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186438.549460:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549478:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186438.549485:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186438.549490:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784186438.549504:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549510:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186438.549517:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549524:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fda505600/0x55bc3e8c99d18f2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18f35 expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549534:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186438.549537:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fca861a00/0x55bc3e8c99d18ecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549542:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fca861a00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186438.549556:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fca861a00/0x55bc3e8c99d18ecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549564:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fca861a00/0x55bc3e8c99d18ecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186438.549570:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fca861a00/0x55bc3e8c99d18ecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186438.549580:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784186438.549592:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fca861a00/0x55bc3e8c99d18ecc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549597:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186438.549610:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fca861a00/0x55bc3e8c99d18ecc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549617:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fca861a00/0x55bc3e8c99d18ecc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d18ed3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.549629:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186438.549631:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186438.549633:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186438.549806:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186438.549820:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937937536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784186438.549865:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186438.549943:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937937408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784186438.549969:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186438.549997:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784186438.550003:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937937280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784186438.550022:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186438.550049:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937937536 00000100:00100000:3.0:1784186438.550055:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937937536 00010000:00010000:3.0:1784186438.550079:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d18ed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18ecc expref: 19 pid: 5774 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186438.550095:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937937408 00000100:00100000:3.0:1784186438.550098:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937937408 00010000:00010000:3.0:1784186438.550117:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc27eca00/0x55bc3e8c99d18f35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f2e expref: 20 pid: 5777 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186438.550128:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937937280 00000100:00100000:3.0:1784186438.550130:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937937280 00010000:00010000:3.0:1784186438.550137:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d19000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18ff9 expref: 21 pid: 5775 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186438.550147:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784186438.550153:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+21:3308:x1870854937937536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186438.550164:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186438.550168:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d18ed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18ecc expref: 21 pid: 5774 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186438.550178:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d18ed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18ecc expref: 21 pid: 5774 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186438.550190:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d18ed3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18ecc expref: 21 pid: 5774 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186438.550204:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186438.550235:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+20:3308:x1870854937937536:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186438.550241:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784186438.550255:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784186438.550260:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5579f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3307:x1870854937937408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186438.550267:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186438.550271:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc27eca00/0x55bc3e8c99d18f35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f2e expref: 19 pid: 5777 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186438.550287:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc27eca00/0x55bc3e8c99d18f35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18f2e expref: 19 pid: 5777 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186438.550295:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27eca00/0x55bc3e8c99d18f35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18f2e expref: 19 pid: 5777 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186438.550304:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186438.550330:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5579f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:3307:x1870854937937408:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186438.550336:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784186438.550348:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784186438.550353:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5579500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:3307:x1870854937937280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186438.550361:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186438.550365:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d19000 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d18ff9 expref: 17 pid: 5775 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186438.550373:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d19000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d18ff9 expref: 17 pid: 5775 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186438.550382:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d19000 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d18ff9 expref: 17 pid: 5775 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186438.550391:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186438.550409:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5579500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+16:3307:x1870854937937280:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186438.550414:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784186438.550488:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937937536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784186438.552752:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937937280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784186438.552802:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937937408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784186438.553092:0:8344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8344:1870854937936768:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186438.553122:0:8344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186438.563917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186438.564062:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915888896 00000100:00100000:0.0:1784186438.564072:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915888896 00010000:00010000:0.0:1784186438.564112:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc9128400/0x55bc3e8c99d190bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c9 expref: 10 pid: 5777 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186438.564154:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:0.0:1784186438.564164:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5579c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2354:x1870854915888896:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186438.564179:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186438.564185:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc9128400/0x55bc3e8c99d190bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c9 expref: 10 pid: 5777 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564209:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc9128400/0x55bc3e8c99d190bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c9 expref: 10 pid: 5777 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564227:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9128400/0x55bc3e8c99d190bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c9 expref: 10 pid: 5777 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564244:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564252:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564269:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564276:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564283:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564289:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564294:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766dc00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186438.564298:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564306:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564339:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.564349:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186438.564408:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5579c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:2354:x1870854915888896:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 245us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186438.564416:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00010000:00010000:1.0:1784186438.564436:0:8344:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186438.564468:0:8344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186438.564475:0:8344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc766dc00/0x55bc3e8c99d1915e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186438.718198:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186438.992366:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186438.992408:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186438.992434:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186438.992491:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915889152 00000100:00100000:0.0:1784186438.992500:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915889152 00000100:00100000:0.0:1784186438.992557:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915889280 00000100:00100000:0.0:1784186438.992561:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915889280 00000100:00100000:0.0:1784186438.992580:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:0.0:1784186438.992590:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915889152:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186438.992913:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915889152:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 322us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186438.992922:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:0.0:1784186438.992956:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:0.0:1784186438.992964:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915889280:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186438.992991:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915889280:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186438.992997:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:0.0:1784186438.993016:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915889024 00000100:00100000:0.0:1784186438.993029:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915889024 00000100:00100000:0.0:1784186438.993061:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:0.0:1784186438.993069:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2356:x1870854915889024:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186438.993099:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2356:x1870854915889024:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 31us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186438.993105:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00080000:0.0:1784186438.993126:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784186438.993130:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784186438.993132:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784186439.741651:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186439.874332:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937937664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784186439.874407:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186439.879207:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937937664 00000100:00100000:0.0:1784186439.879224:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937937664 00000100:00100000:0.0:1784186439.879300:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784186439.879312:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937937664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784186439.879360:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186439.879465:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937937664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (5057us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186439.879472:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1784186439.879497:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784186439.879534:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fed9f3100 x1870854937937664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186439.879555:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937937664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784186440.469804:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186440.470877:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915889408 00000100:00100000:1.0:1784186440.470889:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915889408 00000100:00100000:1.0:1784186440.470970:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 172 00000100:00100000:1.0:1784186440.470980:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:5572:x1870854915889408:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784186440.471001:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186440.471024:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d19165 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576408 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186440.471056:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d19165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576408 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186440.471070:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d19165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576408 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186440.471102:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27eda00, rc 0) 00000100:00100000:1.0:1784186440.471181:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5572:x1870854915889408:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 202us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186440.471189:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 172 00000100:00100000:0.0:1784186440.480667:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186440.484773:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915889536 00000100:00100000:2.0:1784186440.484788:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915889536 00000100:00100000:2.0:1784186440.484992:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 173 00000100:00100000:2.0:1784186440.485005:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5572:x1870854915889536:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784186440.485589:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5572:x1870854915889536:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 585us (4933us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186440.485600:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 173 00000100:00100000:3.0:1784186440.496325:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186440.496431:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915889664 00000100:00100000:0.0:1784186440.496476:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915889664 00000100:00100000:0.0:1784186440.496551:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 174 00000100:00100000:0.0:1784186440.496562:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5572:x1870854915889664:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.496801:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:5572:x1870854915889664:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 239us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.496809:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 174 00000100:00100000:2.0:1784186440.508975:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186440.509920:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915889792 00000100:00100000:3.0:1784186440.509931:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915889792 00000100:00100000:3.0:1784186440.510004:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 175 00000100:00100000:3.0:1784186440.510014:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:6114:x1870854915889792:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784186440.510695:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:6114:x1870854915889792:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 679us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186440.510707:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 175 00000100:00100000:0.0:1784186440.515747:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186440.515792:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915889920 00000100:00100000:2.0:1784186440.515802:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915889920 00000100:00100000:2.0:1784186440.515868:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 176 00000100:00100000:2.0:1784186440.515880:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:6114:x1870854915889920:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784186440.516302:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:6114:x1870854915889920:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 424us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186440.516310:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 176 10000000:01000000:3.0:1784186440.574127:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784186440.574135:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc9c79000 from 4 10000000:01000000:3.0:1784186440.574141:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784186440.574187:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186440.574200:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186440.574210:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186440.574236:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937937792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784186440.574304:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186440.574361:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58780 going to sleep for 11 seconds 00000100:00100000:0.0:1784186440.574595:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937937792 00000100:00100000:0.0:1784186440.574604:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937937792 00000100:00100000:0.0:1784186440.574678:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1784186440.574688:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937937792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186440.574702:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186440.574725:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19173 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1916c expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.575059:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19173 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1916c expref: 17 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.575072:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19173 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1916c expref: 17 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.575094:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129400, rc 0) 00000100:00100000:0.0:1784186440.575152:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937937792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 465us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.575158:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1784186440.575209:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937937792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186440.575224:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.575244:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186440.575303:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937937920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.575336:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.575360:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc4d89000 going to sleep for 11 seconds 00000100:00100000:0.0:1784186440.575374:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937937920 00000100:00100000:0.0:1784186440.575378:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937937920 00000100:00100000:0.0:1784186440.575402:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1784186440.575409:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937937920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.576400:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937937920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 984us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.576411:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784186440.576566:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937937920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186440.576621:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937938048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186440.576673:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186440.576699:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186440.576726:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937938048 00000100:00100000:3.0:1784186440.577229:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937938048 00000100:00100000:3.0:1784186440.577283:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784186440.577293:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937938048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186440.578660:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937938048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1361us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186440.578672:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784186440.579088:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937938048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.580011:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8428:1870854937938176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186440.580074:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.580119:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcd475780 going to sleep for 11 seconds 00000100:00100000:3.0:1784186440.580186:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937938176 00000100:00100000:3.0:1784186440.580193:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937938176 00000100:00100000:3.0:1784186440.580240:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784186440.580249:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:8428:x1870854937938176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186440.580682:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:8428:x1870854937938176:12345-0@lo:502:llog_process_th.0 Request processed in 433us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186440.580690:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1784186440.580869:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8428:1870854937938176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186440.580903:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186440.580912:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186440.580915:0:8428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784186440.580922:0:8428:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9fc9c79000 00000020:00000080:0.0:1784186440.580925:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784186440.581007:0:8428:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8428:1870854937938304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186440.581054:0:8428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.581081:0:8428:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffee45480 going to sleep for 11 seconds 00000100:00100000:3.0:1784186440.581140:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937938304 00000100:00100000:3.0:1784186440.581146:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937938304 00000100:00100000:3.0:1784186440.581176:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784186440.581183:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:8428:x1870854937938304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186440.581313:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:8428:x1870854937938304:12345-0@lo:502:llog_process_th.0 Request processed in 130us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186440.581319:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1784186440.585146:0:8428:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8428:1870854937938304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186440.585192:0:8428:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186440.585201:0:8428:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186440.585203:0:8428:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784186440.585208:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784186440.585911:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1784186440.585937:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784186440.585950:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.585962:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186440.585976:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784186440.585978:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9ffef01800 from 4 10000000:01000000:0.0:1784186440.585981:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784186440.586023:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.586032:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.586042:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186440.586067:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937938432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.586139:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.586190:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffee45480 going to sleep for 11 seconds 00000100:00100000:0.0:1784186440.586211:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937938432 00000100:00100000:0.0:1784186440.586217:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937938432 00000100:00100000:0.0:1784186440.586266:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784186440.586275:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937938432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186440.586290:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186440.586303:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9128a00/0x55bc3e8c99d19181 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1917a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.586329:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9128a00/0x55bc3e8c99d19181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1917a expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.586340:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9128a00/0x55bc3e8c99d19181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1917a expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.586348:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128a00, rc 0) 00000100:00100000:0.0:1784186440.586385:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937938432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.586392:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1784186440.586435:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937938432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186440.586480:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.586491:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186440.586535:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937938560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.586560:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.586585:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffee45480 going to sleep for 11 seconds 00000100:00100000:0.0:1784186440.586598:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937938560 00000100:00100000:0.0:1784186440.586602:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937938560 00000100:00100000:0.0:1784186440.588280:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1784186440.588291:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937938560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.591590:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937938560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2826us (4553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.591670:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1784186440.592199:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937938560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.592257:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937938688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.592309:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.592343:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffee45480 going to sleep for 11 seconds 00000100:00100000:0.0:1784186440.592360:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937938688 00000100:00100000:0.0:1784186440.592365:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937938688 00000100:00100000:0.0:1784186440.592402:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784186440.592410:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937938688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.593218:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937938688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 806us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.593226:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1784186440.593278:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937938688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.593522:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8431:1870854937938816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186440.593561:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.593586:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937938816 00000100:00100000:0.0:1784186440.593591:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937938816 00000100:00100000:0.0:1784186440.593640:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1784186440.593649:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:8431:x1870854937938816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186440.596329:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:8431:x1870854937938816:12345-0@lo:502:llog_process_th.0 Request processed in 2669us (2756us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.596344:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1784186440.596436:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffee45300 going to sleep for 11 seconds 00000100:00100000:0.0:1784186440.596477:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8431:1870854937938816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186440.596510:0:8431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186440.596520:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186440.596523:0:8431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784186440.596532:0:8431:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9ffef01800 00000020:00000080:0.0:1784186440.596535:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784186440.596660:0:8431:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8431:1870854937938944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186440.596718:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.597186:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937938944 00000100:00100000:0.0:1784186440.597192:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937938944 00000100:00100000:1.0:1784186440.597205:0:8431:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffee45300 going to sleep for 11 seconds 00000100:00100000:0.0:1784186440.597229:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1784186440.597240:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:8431:x1870854937938944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784186440.597648:0:8431:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8431:1870854937938944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784186440.597683:0:8431:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784186440.597690:0:8431:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784186440.597692:0:8431:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784186440.597699:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:0.0:1784186440.598426:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:8431:x1870854937938944:12345-0@lo:502:llog_process_th.0 Request processed in 201us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.598572:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000020:01000000:0.0:1784186440.599233:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1784186440.599259:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784186440.599273:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.599287:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186440.599307:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784186440.599311:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc5f8f800 from 4 10000000:01000000:0.0:1784186440.599313:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784186440.600221:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.600235:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.600247:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186440.600273:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937939072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.600341:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.600485:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffee45180 going to sleep for 11 seconds 00000100:00100000:1.0:1784186440.600490:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937939072 00000100:00100000:1.0:1784186440.600497:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937939072 00000100:00100000:1.0:1784186440.600544:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1784186440.600554:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937939072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784186440.600567:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186440.600583:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d1918f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d19188 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186440.600607:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d1918f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d19188 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186440.600618:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d1918f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19188 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186440.600636:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ece00, rc 0) 00000100:00100000:0.0:1784186440.600824:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937939072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186440.600840:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.600849:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186440.600906:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937939200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.602882:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.602929:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffee45180 going to sleep for 11 seconds 00000100:00100000:0.0:1784186440.603208:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937939200 00000100:00100000:0.0:1784186440.603217:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937939200 00000100:00100000:0.0:1784186440.603263:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1784186440.603271:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+20:5780:x1870854937939200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784186440.612053:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+20:5780:x1870854937939072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 11490us (11701us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186440.612076:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1784186440.613143:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937939200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 9867us (10262us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.613156:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1784186440.613230:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937939200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.613289:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937939328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.613336:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.613375:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffee45180 going to sleep for 11 seconds 00000100:00100000:0.0:1784186440.613392:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937939328 00000100:00100000:0.0:1784186440.613398:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937939328 00000100:00100000:0.0:1784186440.613436:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1784186440.613460:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937939328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.613660:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937939328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.613666:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1784186440.613704:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937939328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186440.613884:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8434:1870854937939456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186440.613918:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.613937:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937939456 00000100:00100000:0.0:1784186440.613941:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937939456 00000100:00100000:0.0:1784186440.613962:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784186440.613967:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:8434:x1870854937939456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186440.614087:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:8434:x1870854937939456:12345-0@lo:502:llog_process_th.0 Request processed in 119us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.614100:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1784186440.614129:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffee45240 going to sleep for 11 seconds 00000100:00100000:0.0:1784186440.614142:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8434:1870854937939456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186440.614164:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186440.614175:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186440.614178:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784186440.614188:0:8434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9fc5f8f800 00000020:00000080:0.0:1784186440.614190:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784186440.614599:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8434:1870854937939584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186440.614648:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186440.614670:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937939584 00000100:00100000:0.0:1784186440.614674:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937939584 00000100:00100000:0.0:1784186440.614696:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1784186440.614702:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:8434:x1870854937939584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186440.614816:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:8434:x1870854937939584:12345-0@lo:502:llog_process_th.0 Request processed in 113us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186440.614822:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1784186440.614851:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffee45240 going to sleep for 11 seconds 00000100:00100000:0.0:1784186440.614862:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:8434:1870854937939584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186440.614879:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186440.614884:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186440.614885:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784186440.614890:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1784186440.614935:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1784186440.614950:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784186440.614960:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.614975:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186440.765565:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186440.898177:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937939840:0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.898251:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186440.898309:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784186440.898316:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937939712:0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.898341:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186440.898368:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937940224:0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.898392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186440.898428:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937940096:0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.898483:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186440.898503:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784186440.898508:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937939968:0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.898531:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186440.898561:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937940224 00000100:00100000:2.0:1784186440.898569:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937940224 00000100:00100000:2.0:1784186440.898639:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937939968 00000100:00100000:2.0:1784186440.898643:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937939968 00000100:00100000:2.0:1784186440.898662:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784186440.898681:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937940224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.898737:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937940224:12345-0@lo:400:kworker.0 Request processed in 66us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186440.898745:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784186440.898762:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784186440.898768:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937939968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.898832:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937939968:12345-0@lo:400:kworker.0 Request processed in 63us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186440.898839:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784186440.898857:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937939840 00000100:00100000:2.0:1784186440.898861:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937939840 00000100:00100000:2.0:1784186440.898886:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937939712 00000100:00100000:2.0:1784186440.898888:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937939712 00000100:00100000:2.0:1784186440.898899:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937940096 00000100:00100000:2.0:1784186440.898902:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937940096 00000100:00100000:2.0:1784186440.898916:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784186440.898922:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937939840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.898952:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937939840:12345-0@lo:400:kworker.0 Request processed in 30us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186440.898958:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784186440.898969:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784186440.898975:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937939712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.899003:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937939712:12345-0@lo:400:kworker.0 Request processed in 28us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186440.899008:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784186440.899020:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784186440.899026:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937940096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.899051:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937940096:12345-0@lo:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186440.899055:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1784186440.899074:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784186440.899078:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784186440.899108:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe87c380 x1870854937939968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186440.899129:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937939968:0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.899142:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937940096:0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.899171:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937939712:0@lo:400:kworker.0 00010000:00080000:2.0:1784186440.899182:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe87d500 x1870854937940224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186440.899191:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937940224:0@lo:400:kworker.0 00000100:00100000:2.0:1784186440.899202:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937939840:0@lo:400:kworker.0 00000100:00100000:0.0:1784186441.410809:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784186441.410890:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937940352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186441.410964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186441.411148:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937940352 00000100:00100000:1.0:1784186441.411157:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937940352 00000100:00100000:1.0:1784186441.411209:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784186441.411220:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937940352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784186441.411254:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186441.411301:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937940352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186441.411308:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1784186441.411347:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c59f80 x1870854937940352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186441.411366:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937940352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784186441.789568:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186442.813784:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186443.837829:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186444.122708:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186444.122740:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186444.122770:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186444.122795:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186444.122822:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915890048 00000100:00100000:0.0:1784186444.122831:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915890048 00000100:00100000:0.0:1784186444.122881:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 192 00000100:00100000:0.0:1784186444.122890:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2355:x1870854915890048:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186444.122957:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2355:x1870854915890048:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 68us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186444.122965:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 192 00000100:00100000:0.0:1784186444.122996:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915890432 00000100:00100000:0.0:1784186444.123000:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915890432 00000100:00100000:0.0:1784186444.123033:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915890304 00000100:00100000:0.0:1784186444.123036:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915890304 00000100:00100000:0.0:1784186444.123053:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:0.0:1784186444.123060:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915890432:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186444.123097:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915890432:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 37us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186444.123104:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:0.0:1784186444.123115:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:0.0:1784186444.123121:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915890304:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186444.123141:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915890304:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 20us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186444.123147:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00080000:0.0:1784186444.123280:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784186444.123284:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784186444.123355:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915890176 00000100:00100000:2.0:1784186444.123360:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915890176 00000100:00100000:2.0:1784186444.123418:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:2.0:1784186444.123426:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2355:x1870854915890176:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186444.123486:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2355:x1870854915890176:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 61us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186444.123492:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00080000:0.0:1784186444.127595:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784186444.867846:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186444.990192:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784186444.990215:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937940480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784186444.990287:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186444.990354:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937940480 00000100:00100000:2.0:1784186444.990362:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937940480 00000100:00100000:2.0:1784186444.990418:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784186444.990427:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937940480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784186444.990476:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186444.990539:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937940480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186444.990547:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1784186444.990576:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784186444.990605:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe87fb80 x1870854937940480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186444.990623:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937940480:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1784186445.701226:0:8642:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1784186445.904837:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186446.013769:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937940992:0@lo:400:kworker.0 00000100:00100000:3.0:1784186446.013775:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937940864:0@lo:400:kworker.0 00000100:00100000:1.0:1784186446.013848:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937940736:0@lo:400:kworker.0 00000100:00100000:2.0:1784186446.013904:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937940608:0@lo:400:kworker.0 00000100:00100000:3.0:1784186446.017200:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186446.017200:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186446.017275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186446.017303:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937941248:0@lo:400:kworker.0 00000100:00100000:1.0:1784186446.017338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186446.017390:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937940864 00000100:00100000:1.0:1784186446.017398:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937940864 00000100:00100000:1.0:1784186446.017486:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937940736 00000100:00100000:1.0:1784186446.017489:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937940736 00000100:00100000:1.0:1784186446.017523:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784186446.017530:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937940864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186446.017995:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937940864:12345-0@lo:400:kworker.0 Request processed in 81us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186446.018018:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784186446.018042:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784186446.018049:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937940736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186446.018092:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937940736:12345-0@lo:400:kworker.0 Request processed in 44us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186446.018098:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784186446.018238:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937940864:0@lo:400:kworker.0 00000100:00100000:1.0:1784186446.018275:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937940736:0@lo:400:kworker.0 00000100:00100000:1.0:1784186446.018312:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937940992 00000100:00100000:1.0:1784186446.018316:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937940992 00000100:00100000:1.0:1784186446.018342:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937941248 00000100:00100000:1.0:1784186446.018346:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937941248 00000100:00100000:1.0:1784186446.018363:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784186446.018369:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937940992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186446.018403:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937940992:12345-0@lo:400:kworker.0 Request processed in 35us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186446.018409:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784186446.018605:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784186446.018799:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937941248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186446.018842:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937941248:12345-0@lo:400:kworker.0 Request processed in 230us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186446.018850:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1784186446.018884:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fd11b4380 x1870854937941248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186446.018896:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937941248:0@lo:400:kworker.0 00000100:00080000:1.0:1784186446.018940:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186446.018944:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784186446.018947:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186446.019045:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186446.019088:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937941120:0@lo:400:kworker.0 00000100:00100000:2.0:1784186446.019192:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186446.019226:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937941120 00000100:00100000:2.0:1784186446.019231:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937941120 00000100:00100000:2.0:1784186446.019265:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784186446.019272:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937941120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186446.019307:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937941120:12345-0@lo:400:kworker.0 Request processed in 36us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186446.019313:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1784186446.019332:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186446.019350:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937941120:0@lo:400:kworker.0 00000100:00100000:1.0:1784186446.019438:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937940608 00000100:00100000:1.0:1784186446.019841:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937940608 00000100:00100000:1.0:1784186446.019880:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1784186446.019888:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937940608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186446.019926:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937940608:12345-0@lo:400:kworker.0 Request processed in 40us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186446.019933:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784186446.020027:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937940608:0@lo:400:kworker.0 00010000:00080000:0.0:1784186446.024173:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe557aa00 x1870854937940992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186446.024193:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937940992:0@lo:400:kworker.0 00000100:00100000:1.0:1784186446.526772:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937941376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186446.526847:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186446.526918:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937941376 00000100:00100000:1.0:1784186446.526926:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937941376 00000100:00100000:1.0:1784186446.526974:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784186446.526982:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937941376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784186446.527017:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186446.527059:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937941376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186446.527067:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1784186446.527113:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c59880 x1870854937941376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186446.527132:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937941376:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784186446.911852:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186447.947340:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186448.960379:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186449.241584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186449.241665:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915890560 00000100:00100000:3.0:1784186449.241678:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915890560 00000100:00100000:3.0:1784186449.241751:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 194 00000100:00100000:3.0:1784186449.241762:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2356:x1870854915890560:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186449.241847:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2356:x1870854915890560:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 87us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186449.241856:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 194 00000100:00100000:3.0:1784186449.245536:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186449.245722:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915890688 00000100:00100000:1.0:1784186449.245732:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915890688 00000100:00100000:1.0:1784186449.245821:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:1.0:1784186449.245831:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2356:x1870854915890688:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186449.245910:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2356:x1870854915890688:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 80us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186449.245917:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00080000:3.0:1784186449.246829:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186449.257972:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186449.258015:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186449.258093:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915890816 00000100:00100000:2.0:1784186449.258102:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915890816 00000100:00100000:3.0:1784186449.258106:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915890944 00000100:00100000:3.0:1784186449.258110:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915890944 00000100:00100000:2.0:1784186449.258183:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:2.0:1784186449.258192:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2353:x1870854915890816:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:2.0:1784186449.258228:0:6581:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d190cb 00000100:00080000:2.0:1784186449.258238:0:6581:0:(import.c:65:import_set_state_nolock()) ffff9b9ec4a81000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784186449.258280:0:6581:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1784186449.258648:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186449.258910:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+2:2353:x1870854915890816:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 717us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186449.258919:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:2.0:1784186449.258937:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:2.0:1784186449.258944:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2353:x1870854915890944:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:2.0:1784186449.258960:0:6581:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d190d2 00000100:00080000:2.0:1784186449.258967:0:6581:0:(import.c:65:import_set_state_nolock()) ffff9b9ec4a83800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784186449.258989:0:6581:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784186449.259193:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+2:2353:x1870854915890944:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 249us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186449.259200:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00010000:00010000:2.0:1784186449.259267:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784186449.259644:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186449.259649:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784186449.982060:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186450.111133:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937941504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784186450.111208:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186450.111336:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937941504 00000100:00100000:0.0:1784186450.111346:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937941504 00000100:00100000:0.0:1784186450.111414:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784186450.111423:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937941504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784186450.111481:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186450.111534:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937941504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186450.111567:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1784186450.111730:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784186450.111761:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fed9f0e00 x1870854937941504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186450.111781:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937941504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784186451.006778:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186451.134819:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937941760:0@lo:400:kworker.0 00000100:00100000:1.0:1784186451.134894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186451.135030:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937942016:0@lo:400:kworker.0 00000100:00100000:3.0:1784186451.135065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186451.135098:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784186451.135103:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937941632:0@lo:400:kworker.0 00000100:00100000:3.0:1784186451.135130:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186451.135147:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937942144:0@lo:400:kworker.0 00000100:00100000:3.0:1784186451.135166:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186451.135192:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937942016 00000100:00100000:3.0:1784186451.135200:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937942016 00000100:00100000:3.0:1784186451.135244:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784186451.135254:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937942016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186451.135317:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937942016:12345-0@lo:400:kworker.0 Request processed in 63us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186451.135326:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1784186451.135368:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe557a680 x1870854937942016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186451.135382:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937942016:0@lo:400:kworker.0 00000100:00100000:1.0:1784186451.135625:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937942272:0@lo:400:kworker.0 00000100:00100000:1.0:1784186451.135653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186451.135676:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186451.135681:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937941888:0@lo:400:kworker.0 00000100:00100000:1.0:1784186451.135702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186451.135731:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937941760 00000100:00100000:1.0:1784186451.135734:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937941760 00000100:00100000:1.0:1784186451.135756:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937942144 00000100:00100000:1.0:1784186451.135758:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937942144 00000100:00100000:1.0:1784186451.135773:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937941888 00000100:00100000:1.0:1784186451.135776:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937941888 00000100:00100000:1.0:1784186451.135790:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784186451.135796:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937941760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186451.135831:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937941760:12345-0@lo:400:kworker.0 Request processed in 35us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186451.135848:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784186451.135867:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784186451.135873:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937942144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186451.135905:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937942144:12345-0@lo:400:kworker.0 Request processed in 32us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186451.135910:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784186451.135921:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784186451.135926:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937941888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186451.136505:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937942272 00000100:00100000:3.0:1784186451.136511:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937942272 00000100:00100000:3.0:1784186451.136616:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784186451.136625:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937942272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186451.136792:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937941632 00000100:00100000:2.0:1784186451.136797:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937941632 00000100:00100000:2.0:1784186451.136831:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1784186451.136837:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937941632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186451.140309:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937942272:12345-0@lo:400:kworker.0 Request processed in 3676us (4644us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186451.140325:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1784186451.140362:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784186451.140367:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186451.140405:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937942144:0@lo:400:kworker.0 00000100:00100000:1.0:1784186451.140807:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937941888:12345-0@lo:400:kworker.0 Request processed in 4879us (5101us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186451.140817:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784186451.142270:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937941632:12345-0@lo:400:kworker.0 Request processed in 5425us (7131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186451.142285:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1784186451.142472:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937941760:0@lo:400:kworker.0 00010000:00080000:0.0:1784186451.142492:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ec7296a00 x1870854937942272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186451.142503:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937942272:0@lo:400:kworker.0 00000100:00100000:0.0:1784186451.142652:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937941888:0@lo:400:kworker.0 00000100:00100000:3.0:1784186451.144379:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937941632:0@lo:400:kworker.0 00000001:02000400:2.0:1784186451.210251:0:8886:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing yml_node 00000100:00100000:2.0:1784186451.645643:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937942400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784186451.645729:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186451.646841:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937942400 00000100:00100000:1.0:1784186451.646852:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937942400 00000100:00100000:1.0:1784186451.646920:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784186451.646930:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937942400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784186451.646972:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186451.647035:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937942400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186451.647042:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1784186451.647176:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ec7297800 x1870854937942400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186451.647196:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937942400:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1784186451.737477:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00000020:00000080:3.0:1784186451.737485:0:7480:0:(genops.c:906:class_export_put()) final put ffff9b9ec4a80800/efb6eb2c-5579-43c6-be4f-310412860e5b 00000020:00000080:1.0:1784186451.737836:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec4a80800/efb6eb2c-5579-43c6-be4f-310412860e5b for lustre-OST0001 00000020:00000080:1.0:1784186451.737881:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ec4a83800 for lustre-OST0001 00010000:00010000:0.0:1784186452.034183:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186453.058070:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784186453.301398:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00000020:00000080:2.0:1784186453.301411:0:6607:0:(genops.c:906:class_export_put()) final put ffff9b9ec4a82800/efb6eb2c-5579-43c6-be4f-310412860e5b 00000020:00000080:0.0:1784186453.301529:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec4a82800/efb6eb2c-5579-43c6-be4f-310412860e5b for lustre-OST0000 00000020:00000080:0.0:1784186453.301593:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ec4a81000 for lustre-OST0000 00010000:00010000:0.0:1784186454.077871:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186454.354289:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186454.354340:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186454.354645:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915891200 00000100:00100000:2.0:1784186454.354662:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915891200 00000100:00100000:2.0:1784186454.354789:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:1.0:1784186454.354790:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915891072 00000100:00100000:1.0:1784186454.354805:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915891072 00000100:00100000:2.0:1784186454.354813:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915891200:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186454.354889:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 196 00000100:00100000:1.0:1784186454.354902:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2357:x1870854915891072:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186454.354940:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915891200:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 132us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186454.354952:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:1.0:1784186454.355003:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2357:x1870854915891072:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 100us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186454.355016:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 196 00000100:00080000:3.0:1784186454.355472:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784186455.107218:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186455.231026:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937942528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784186455.231147:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186455.231304:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937942528 00000100:00100000:1.0:1784186455.231316:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937942528 00000100:00100000:1.0:1784186455.231418:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784186455.231430:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937942528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784186455.231525:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784186455.231640:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784186455.232612:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937942528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1176us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186455.232627:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1784186455.232810:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fed9f0e00 x1870854937942528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186455.232976:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937942528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784186456.131783:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186456.253938:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937942912:0@lo:400:kworker.0 00000100:00100000:2.0:1784186456.254056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186456.254154:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784186456.254163:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937942784:0@lo:400:kworker.0 00000100:00100000:2.0:1784186456.254201:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186456.254232:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937943296:0@lo:400:kworker.0 00000100:00100000:2.0:1784186456.254275:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186456.254332:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937942912 00000100:00100000:2.0:1784186456.254342:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937942912 00000100:00100000:1.0:1784186456.254561:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937943040:0@lo:400:kworker.0 00000100:00100000:1.0:1784186456.254599:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186456.254624:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784186456.254629:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937942656:0@lo:400:kworker.0 00000100:00100000:1.0:1784186456.254661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186456.254687:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937943168:0@lo:400:kworker.0 00000100:00100000:1.0:1784186456.254710:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186456.254739:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937943168 00000100:00100000:1.0:1784186456.254743:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937943168 00000100:00100000:1.0:1784186456.254770:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784186456.254781:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937942912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186456.254858:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937942912:12345-0@lo:400:kworker.0 Request processed in 78us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186456.254866:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784186456.254905:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784186456.254912:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937943168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186456.254948:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937943168:12345-0@lo:400:kworker.0 Request processed in 37us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186456.254955:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784186456.254984:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937942656 00000100:00100000:1.0:1784186456.254989:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937942656 00000100:00100000:1.0:1784186456.255017:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1784186456.255023:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937942656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186456.255054:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937942656:12345-0@lo:400:kworker.0 Request processed in 32us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186456.255060:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1784186456.255118:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937942656:0@lo:400:kworker.0 00000100:00100000:1.0:1784186456.255133:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937943168:0@lo:400:kworker.0 00000100:00100000:1.0:1784186456.255174:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937942912:0@lo:400:kworker.0 00000100:00100000:3.0:1784186456.255353:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937943296 00000100:00100000:3.0:1784186456.255358:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937943296 00000100:00100000:3.0:1784186456.255407:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937943040 00000100:00100000:3.0:1784186456.255412:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937943040 00000100:00100000:3.0:1784186456.255429:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784186456.255436:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937943296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186456.255540:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937943296:12345-0@lo:400:kworker.0 Request processed in 102us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186456.255551:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784186456.255572:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784186456.255583:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937943040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186456.255624:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7295880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937943040:12345-0@lo:400:kworker.0 Request processed in 46us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186456.255631:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1784186456.255671:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe87dc00 x1870854937943040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186456.255686:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937943040:0@lo:400:kworker.0 00010000:00080000:3.0:1784186456.255715:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffd9de300 x1870854937943296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186456.255725:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937943296:0@lo:400:kworker.0 00000100:00100000:2.0:1784186456.256411:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937942784 00000100:00100000:2.0:1784186456.256424:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937942784 00000100:00080000:3.0:1784186456.256628:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784186456.256636:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186456.256739:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784186456.256748:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937942784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186456.256879:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937942784:12345-0@lo:400:kworker.0 Request processed in 132us (2681us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186456.256886:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784186456.261254:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937942784:0@lo:400:kworker.0 00000001:02000400:3.0:1784186456.694202:0:9082:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00000100:00100000:1.0:1784186456.766576:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186456.766610:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937943424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186456.766708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186456.773608:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937943424 00000100:00100000:3.0:1784186456.773647:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937943424 00000100:00100000:3.0:1784186456.773735:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784186456.773749:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937943424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784186456.773807:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186456.773940:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937943424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 194us (7231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186456.773949:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1784186456.774780:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ec7294a80 x1870854937943424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186456.774816:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937943424:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784186457.149805:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186458.173782:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186459.197868:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186459.472174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186459.472224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186459.472348:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915891328 00000100:00100000:1.0:1784186459.472359:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915891328 00000100:00100000:1.0:1784186459.472426:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 198 00000100:00100000:1.0:1784186459.472438:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2354:x1870854915891328:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186459.472542:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2354:x1870854915891328:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 107us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186459.472566:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 198 00000100:00100000:0.0:1784186459.473391:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915891456 00000100:00100000:0.0:1784186459.473535:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915891456 00000100:00100000:1.0:1784186459.473892:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:1.0:1784186459.473904:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915891456:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186459.473981:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915891456:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 78us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186459.473988:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00080000:3.0:1784186459.474725:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1784186459.716052:0:9180:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00010000:00010000:2.0:1784186460.227748:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186460.349930:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937943552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186460.350005:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186460.350219:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937943552 00000100:00100000:3.0:1784186460.350227:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937943552 00000100:00100000:3.0:1784186460.350308:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784186460.350318:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937943552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784186460.350353:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186460.350421:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937943552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186460.350429:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1784186460.350514:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784186460.350825:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fed9f3100 x1870854937943552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186460.350847:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937943552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784186461.245702:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186461.373885:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937943936:0@lo:400:kworker.0 00000100:00100000:1.0:1784186461.373963:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186461.374042:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784186461.374048:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937943808:0@lo:400:kworker.0 00000100:00100000:1.0:1784186461.374082:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186461.374099:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937944320:0@lo:400:kworker.0 00000100:00100000:1.0:1784186461.374123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186461.374160:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937943936 00000100:00100000:1.0:1784186461.374167:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937943936 00000100:00100000:1.0:1784186461.374216:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937943808 00000100:00100000:1.0:1784186461.374219:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937943808 00000100:00100000:1.0:1784186461.374240:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784186461.374248:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937943936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186461.374345:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937943936:12345-0@lo:400:kworker.0 Request processed in 97us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186461.374353:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784186461.374468:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937944064:0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.374500:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186461.374528:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784186461.374534:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937943680:0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.374562:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186461.374586:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937944192:0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.374608:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186461.374628:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937944320 00000100:00100000:0.0:1784186461.374644:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937944320 00000100:00100000:0.0:1784186461.374675:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937944064 00000100:00100000:0.0:1784186461.374678:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937944064 00000100:00100000:0.0:1784186461.374692:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784186461.374698:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937944320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.374731:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937944320:12345-0@lo:400:kworker.0 Request processed in 33us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186461.374738:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784186461.374755:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784186461.374761:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937944064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.374792:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937944064:12345-0@lo:400:kworker.0 Request processed in 31us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186461.374799:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1784186461.374836:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ec7294380 x1870854937944064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186461.374851:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937944064:0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.374893:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937944192 00000100:00100000:0.0:1784186461.374896:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937944192 00000100:00080000:2.0:1784186461.376487:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784186461.376497:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186461.376924:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784186461.376943:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937943808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.377027:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937943808:12345-0@lo:400:kworker.0 Request processed in 94us (2943us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186461.377034:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784186461.378215:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784186461.378231:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937944192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.378465:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937944192:12345-0@lo:400:kworker.0 Request processed in 240us (3855us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186461.378486:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784186461.378550:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937944192:0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.378595:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937943680 00000100:00100000:0.0:1784186461.378601:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937943680 00000100:00100000:0.0:1784186461.378642:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784186461.378649:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937943680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.378685:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937943680:12345-0@lo:400:kworker.0 Request processed in 37us (4122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186461.378692:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784186461.378722:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937943680:0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.378770:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937943808:0@lo:400:kworker.0 00010000:00080000:0.0:1784186461.378785:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ec7294e00 x1870854937944320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186461.378796:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937944320:0@lo:400:kworker.0 00000100:00100000:0.0:1784186461.378808:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937943936:0@lo:400:kworker.0 00000100:00100000:3.0:1784186461.887387:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186461.887420:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937944448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784186461.887521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186461.888524:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937944448 00000100:00100000:3.0:1784186461.888538:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937944448 00000100:00100000:1.0:1784186461.888617:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784186461.888643:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937944448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784186461.888682:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186461.888775:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937944448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186461.888783:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1784186461.889797:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fd11b5f80 x1870854937944448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186461.889822:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937944448:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784186462.275221:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784186462.316809:0:9278:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:1.0:1784186463.294691:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784186464.106086:0:9326:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Jul 16 03:21:02 EDT 2026 00010000:00010000:0.0:1784186464.321192:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186464.600803:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186464.600862:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186464.600994:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915891712 00000100:00100000:0.0:1784186464.601005:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915891712 00000100:00100000:3.0:1784186464.601086:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915891584 00000100:00100000:0.0:1784186464.601092:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:3.0:1784186464.601094:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915891584 00000100:00100000:0.0:1784186464.601106:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915891712:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186464.601135:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 200 00000100:00100000:3.0:1784186464.601153:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2356:x1870854915891584:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186464.601338:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915891712:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 234us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186464.601346:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00080000:2.0:1784186464.602352:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186464.603399:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2356:x1870854915891584:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 2240us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186464.603411:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 200 00010000:00010000:2.0:1784186465.341749:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186465.470682:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784186465.470710:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937944576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784186465.470788:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186465.470896:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937944576 00000100:00100000:0.0:1784186465.470908:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937944576 00000100:00080000:3.0:1784186465.471053:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784186465.471086:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784186465.471105:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937944576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784186465.471143:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186465.471201:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937944576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186465.471209:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1784186465.471342:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe83dc00 x1870854937944576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186465.471364:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937944576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784186466.365602:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186466.495942:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937945088:0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.496014:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186466.496069:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784186466.496076:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937944704:0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.496105:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186466.496129:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937945216:0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.496154:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186466.496181:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937944832:0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.496217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186466.496235:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937945344:0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.496259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186466.496279:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186466.496284:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937944960:0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.496305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186466.496335:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937945088 00000100:00100000:1.0:1784186466.496342:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937945088 00000100:00100000:1.0:1784186466.496381:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937945344 00000100:00100000:1.0:1784186466.496384:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937945344 00000100:00100000:1.0:1784186466.496411:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784186466.496419:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937945088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.496502:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937945088:12345-0@lo:400:kworker.0 Request processed in 83us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186466.496510:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784186466.496535:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784186466.496541:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937945344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.496572:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937945344:12345-0@lo:400:kworker.0 Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186466.496579:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784186466.496598:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937944704 00000100:00100000:1.0:1784186466.496601:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937944704 00000100:00100000:1.0:1784186466.496625:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1784186466.496631:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937944704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.496659:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937944704:12345-0@lo:400:kworker.0 Request processed in 28us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186466.496665:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1784186466.496691:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937945216 00000100:00100000:1.0:1784186466.496912:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937945216 00000100:00100000:1.0:1784186466.496944:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937944832 00000100:00100000:1.0:1784186466.496947:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937944832 00000100:00100000:1.0:1784186466.496958:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937944960 00000100:00100000:1.0:1784186466.496961:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937944960 00000100:00100000:1.0:1784186466.496976:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784186466.496982:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937945216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.497011:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937945216:12345-0@lo:400:kworker.0 Request processed in 30us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186466.497017:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784186466.497029:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784186466.497041:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937944832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.497067:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937944832:12345-0@lo:400:kworker.0 Request processed in 26us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186466.497072:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784186466.497085:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784186466.497091:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937944960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.497117:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937944960:12345-0@lo:400:kworker.0 Request processed in 26us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186466.497123:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1784186466.497150:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784186466.497154:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784186466.497180:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937944704:0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.497206:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937945216:0@lo:400:kworker.0 00010000:00080000:1.0:1784186466.497220:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ec7294e00 x1870854937945088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186466.497231:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937945088:0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.497265:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937944960:0@lo:400:kworker.0 00000100:00100000:1.0:1784186466.497274:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937944832:0@lo:400:kworker.0 00010000:00080000:1.0:1784186466.497283:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ec7297100 x1870854937945344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186466.497291:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937945344:0@lo:400:kworker.0 00000100:00100000:2.0:1784186467.005816:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784186467.005846:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937945472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784186467.005941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186467.007761:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937945472 00000100:00100000:3.0:1784186467.007775:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937945472 00000100:00100000:3.0:1784186467.007831:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784186467.007841:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937945472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784186467.007877:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186467.008004:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937945472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186467.008012:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1784186467.011522:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fd11b5500 x1870854937945472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186467.011555:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937945472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784186467.389763:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186468.413617:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186469.437653:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186469.718215:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186469.718348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186469.718376:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915891840 00000100:00100000:3.0:1784186469.718385:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915891840 00000100:00100000:3.0:1784186469.718434:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 202 00000100:00100000:3.0:1784186469.718470:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2354:x1870854915891840:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186469.718556:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2354:x1870854915891840:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 112us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186469.718564:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 202 00000100:00100000:3.0:1784186469.718605:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915891968 00000100:00100000:3.0:1784186469.718609:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915891968 00000100:00100000:3.0:1784186469.718648:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:3.0:1784186469.718655:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915891968:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186469.718684:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915891968:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186469.718690:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00080000:2.0:1784186469.720521:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784186470.466108:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186470.590773:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784186470.591099:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937945600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784186470.591247:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186470.591658:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937945600 00000100:00100000:0.0:1784186470.591666:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937945600 00000100:00100000:0.0:1784186470.591746:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784186470.591754:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937945600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784186470.591785:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186470.591834:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937945600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186470.591839:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1784186470.591947:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe83ea00 x1870854937945600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186470.591969:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937945600:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784186470.592015:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784186471.485948:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186471.619210:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937945728:0@lo:400:kworker.0 00000100:00100000:3.0:1784186471.619292:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186471.619472:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937945728 00000100:00100000:2.0:1784186471.619482:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937945728 00000100:00100000:2.0:1784186471.619541:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1784186471.619551:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937945728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.627977:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937946112:0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.628063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186471.628127:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784186471.628134:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937946240:0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.628162:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186471.628200:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937945856:0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.628227:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186471.628244:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937946368:0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.628265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186471.628284:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784186471.628290:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937945984:0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.628311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186471.628357:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937946112 00000100:00100000:0.0:1784186471.628364:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937946112 00000100:00100000:0.0:1784186471.628408:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937946368 00000100:00100000:0.0:1784186471.628412:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937946368 00000100:00100000:0.0:1784186471.628457:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784186471.628467:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937946112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.628521:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937946112:12345-0@lo:400:kworker.0 Request processed in 56us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186471.628529:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784186471.628546:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784186471.628552:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937946368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.628583:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937946368:12345-0@lo:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186471.628588:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784186471.628605:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937946240 00000100:00100000:0.0:1784186471.628608:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937946240 00000100:00100000:0.0:1784186471.628632:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937945856 00000100:00100000:0.0:1784186471.628635:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937945856 00000100:00100000:0.0:1784186471.628645:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937945984 00000100:00100000:0.0:1784186471.628647:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937945984 00000100:00100000:0.0:1784186471.628659:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784186471.628672:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937946240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.628972:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937946240:12345-0@lo:400:kworker.0 Request processed in 300us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186471.628978:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784186471.628992:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784186471.628998:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937945856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.629027:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937945856:12345-0@lo:400:kworker.0 Request processed in 29us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186471.629033:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784186471.629044:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784186471.629050:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937945984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.629077:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe062300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937945984:12345-0@lo:400:kworker.0 Request processed in 27us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186471.629083:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1784186471.629118:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784186471.629123:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784186471.629156:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937946240:0@lo:400:kworker.0 00010000:00080000:0.0:1784186471.629172:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe83df80 x1870854937946112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186471.629183:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937946112:0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.629215:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937945984:0@lo:400:kworker.0 00000100:00100000:0.0:1784186471.629225:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937945856:0@lo:400:kworker.0 00010000:00080000:0.0:1784186471.629233:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe83dc00 x1870854937946368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186471.629256:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937946368:0@lo:400:kworker.0 00000100:00100000:2.0:1784186471.631965:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937945728:12345-0@lo:400:kworker.0 Request processed in 12406us (12662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186471.631980:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1784186471.637332:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937945728:0@lo:400:kworker.0 00000100:00100000:0.0:1784186472.127408:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784186472.127431:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937946496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186472.127546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186472.127611:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937946496 00000100:00100000:0.0:1784186472.127619:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937946496 00000100:00100000:1.0:1784186472.138480:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784186472.138508:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937946496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784186472.138549:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186472.138637:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937946496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (11091us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186472.138645:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1784186472.140625:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe060e00 x1870854937946496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186472.140651:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937946496:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784186472.510729:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186473.540135:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186474.560548:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186474.836121:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186474.837272:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186474.837424:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915892224 00000100:00100000:1.0:1784186474.837433:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915892224 00000100:00100000:1.0:1784186474.837534:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:1.0:1784186474.837547:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915892224:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186474.837625:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915892224:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 80us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186474.837633:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00080000:0.0:1784186474.837745:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186474.838107:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915892096 00000100:00100000:3.0:1784186474.838209:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915892096 00000100:00100000:3.0:1784186474.838250:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 204 00000100:00100000:3.0:1784186474.838258:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2354:x1870854915892096:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186474.838371:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2354:x1870854915892096:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 45us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186474.838390:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 204 00010000:00010000:0.0:1784186475.582244:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186475.709771:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937946624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784186475.709852:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186475.709968:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937946624 00000100:00100000:1.0:1784186475.709976:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937946624 00000100:00080000:0.0:1784186475.710311:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784186475.710403:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784186475.710414:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937946624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784186475.710487:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186475.710536:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937946624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186475.710543:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1784186475.710614:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe062a00 x1870854937946624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186475.710633:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937946624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784186476.605735:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186476.733753:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784186476.733886:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937946880:0@lo:400:kworker.0 00000100:00100000:1.0:1784186476.733964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186476.734055:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186476.734062:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937947008:0@lo:400:kworker.0 00000100:00100000:1.0:1784186476.734088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186476.734135:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937946880 00000100:00100000:1.0:1784186476.734143:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937946880 00000100:00100000:1.0:1784186476.734192:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937947008 00000100:00100000:1.0:1784186476.734195:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937947008 00000100:00100000:1.0:1784186476.734224:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784186476.734233:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937946880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186476.734290:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937946880:12345-0@lo:400:kworker.0 Request processed in 58us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186476.734298:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784186476.734317:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784186476.734323:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937947008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186476.734344:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937947008:12345-0@lo:400:kworker.0 Request processed in 23us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186476.734348:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784186476.734383:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937947008:0@lo:400:kworker.0 00000100:00100000:1.0:1784186476.734393:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937946880:0@lo:400:kworker.0 00000100:00080000:1.0:1784186476.734430:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186476.736071:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784186476.736096:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937947136:0@lo:400:kworker.0 00000100:00100000:3.0:1784186476.736158:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186476.736628:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937947136 00000100:00100000:1.0:1784186476.736636:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937947136 00000100:00100000:1.0:1784186476.736694:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784186476.736703:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937947136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186476.736965:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937946752:0@lo:400:kworker.0 00000100:00100000:2.0:1784186476.737278:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784186476.737289:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937947392:0@lo:400:kworker.0 00010000:00080000:3.0:1784186476.739310:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc2f71180 x1870854937947136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186476.739330:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937947136:0@lo:400:kworker.0 00000100:00100000:3.0:1784186476.739365:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937947264:0@lo:400:kworker.0 00000100:00100000:3.0:1784186476.739429:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186476.741184:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937947264 00000100:00100000:3.0:1784186476.741198:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937947264 00000100:00100000:3.0:1784186476.741274:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784186476.741284:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937947264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186476.741352:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937947264:12345-0@lo:400:kworker.0 Request processed in 70us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186476.741359:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784186476.741410:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937947264:0@lo:400:kworker.0 00000100:00080000:3.0:1784186476.741437:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186476.741945:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937947136:12345-0@lo:400:kworker.0 Request processed in 5240us (5783us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186476.741974:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784186476.743099:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186476.743162:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937947392 00000100:00100000:1.0:1784186476.743171:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937947392 00000100:00100000:1.0:1784186476.743574:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784186476.743585:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937947392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186476.743650:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937947392:12345-0@lo:400:kworker.0 Request processed in 68us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186476.743657:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1784186476.743765:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784186476.743818:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc2f70380 x1870854937947392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186476.743832:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937947392:0@lo:400:kworker.0 00000100:00100000:0.0:1784186476.747602:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186476.748671:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937946752 00000100:00100000:3.0:1784186476.748685:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937946752 00000100:00100000:3.0:1784186476.748784:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1784186476.748794:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937946752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186476.748890:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937946752:12345-0@lo:400:kworker.0 Request processed in 97us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186476.748897:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1784186476.749071:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937946752:0@lo:400:kworker.0 00000100:00100000:3.0:1784186477.246462:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937947520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784186477.246534:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186477.246679:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937947520 00000100:00100000:0.0:1784186477.246687:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937947520 00000100:00100000:0.0:1784186477.246742:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784186477.246752:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937947520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186477.246786:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186477.246833:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937947520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186477.246840:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1784186477.247859:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe061c00 x1870854937947520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186477.247880:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937947520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784186477.629618:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784186478.348289:0:9955:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:21:17 (1784186477) === 00010000:00010000:1.0:1784186478.653695:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186478.714626:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186478.714856:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915892352 00000100:00100000:3.0:1784186478.714865:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915892352 00000100:00100000:3.0:1784186478.714930:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 206 00000100:00100000:3.0:1784186478.714941:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:8107:x1870854915892352:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784186478.714958:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186478.715274:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d19196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57640f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186478.715305:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d19196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57640f expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186478.715317:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d19196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57640f expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186478.715327:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17c00, rc 0) 00000100:00100000:3.0:1784186478.715391:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:8107:x1870854915892352:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 452us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186478.715415:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 206 00000100:00100000:2.0:1784186478.719040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186478.719182:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915892480 00000100:00100000:3.0:1784186478.719191:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915892480 00000100:00100000:3.0:1784186478.719244:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 207 00000100:00100000:3.0:1784186478.719255:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:8107:x1870854915892480:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784186478.719577:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:8107:x1870854915892480:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 322us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186478.719585:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 207 00000100:00100000:2.0:1784186478.723870:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186478.723964:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915892608 00000100:00100000:3.0:1784186478.723986:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915892608 00000100:00100000:3.0:1784186478.724056:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 208 00000100:00100000:3.0:1784186478.724066:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:8107:x1870854915892608:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784186478.724314:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:8107:x1870854915892608:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 249us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186478.724323:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 208 00000100:00100000:0.0:1784186478.727674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186478.727792:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915892736 00000100:00100000:2.0:1784186478.727802:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915892736 00000100:00100000:2.0:1784186478.727873:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 209 00000100:00100000:2.0:1784186478.727883:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:8111:x1870854915892736:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784186478.728199:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:8111:x1870854915892736:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 317us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186478.728208:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 209 00000100:00100000:2.0:1784186478.751352:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186478.751435:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915892864 00000100:00100000:3.0:1784186478.751575:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915892864 00000100:00100000:3.0:1784186478.751632:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 210 00000100:00100000:3.0:1784186478.751643:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:8111:x1870854915892864:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784186478.752182:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:8111:x1870854915892864:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 538us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186478.752192:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 210 00000100:00100000:3.0:1784186478.755271:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186478.755471:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915892992 00000100:00100000:0.0:1784186478.755488:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915892992 00000100:00100000:0.0:1784186478.755543:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 211 00000100:00100000:0.0:1784186478.755553:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:8107:x1870854915892992:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784186478.755570:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186478.755587:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9128e00/0x55bc3e8c99d1919d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576439 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186478.755616:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9128e00/0x55bc3e8c99d1919d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576439 expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186478.755628:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9128e00/0x55bc3e8c99d1919d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576439 expref: 12 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186478.755637:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128e00, rc 0) 00000100:00100000:0.0:1784186478.755699:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:8107:x1870854915892992:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 147us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186478.755707:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 211 00000100:00100000:0.0:1784186478.761675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186478.762110:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915893120 00000100:00100000:3.0:1784186478.762134:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915893120 00000100:00100000:3.0:1784186478.762186:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 212 00000100:00100000:3.0:1784186478.763494:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:8107:x1870854915893120:12345-192.168.201.31@tcp:256:mount.lustre.0 20000000:01000000:3.0:1784186478.763528:0:5777:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784186478.763549:0:5777:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784186478.763553:0:5777:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784186478.763556:0:5777:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784186478.763558:0:5777:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1784186478.767556:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:8107:x1870854915893120:12345-192.168.201.31@tcp:256:mount.lustre.0 Request processed in 5300us (5877us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186478.767572:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 212 00000100:00100000:2.0:1784186478.773780:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186478.773895:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915893248 00000100:00100000:1.0:1784186478.773904:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915893248 00000100:00100000:1.0:1784186478.773963:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 213 00000100:00100000:1.0:1784186478.773974:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:8107:x1870854915893248:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784186478.773997:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186478.774014:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc27ed800/0x55bc3e8c99d191a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576440 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186478.774049:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27ed800/0x55bc3e8c99d191a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576440 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186478.774061:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc27ed800/0x55bc3e8c99d191a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576440 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186478.774071:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ed800, rc 0) 00000100:00100000:1.0:1784186478.774143:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:8107:x1870854915893248:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 171us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186478.774151:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 213 00000100:00100000:0.0:1784186478.776255:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186478.776365:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915893376 00000100:00100000:1.0:1784186478.776372:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915893376 00000100:00100000:1.0:1784186478.776425:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 214 00000100:00100000:1.0:1784186478.776435:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:8107:x1870854915893376:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784186478.776832:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:8107:x1870854915893376:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 397us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186478.776841:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 214 00000100:00100000:2.0:1784186478.780636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186478.780924:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915893504 00000100:00100000:0.0:1784186478.780933:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915893504 00000100:00100000:0.0:1784186478.781056:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 215 00000100:00100000:0.0:1784186478.781067:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:8107:x1870854915893504:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784186478.783272:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:8107:x1870854915893504:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 2198us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186478.783301:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 215 00000100:00100000:2.0:1784186478.787980:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186478.788248:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915893632 00000100:00100000:1.0:1784186478.788257:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915893632 00000100:00100000:1.0:1784186478.788313:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 216 00000100:00100000:1.0:1784186478.788323:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:8114:x1870854915893632:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784186478.789076:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:8114:x1870854915893632:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 744us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186478.789087:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 216 00000100:00100000:2.0:1784186478.791650:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186478.792007:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915893760 00000100:00100000:3.0:1784186478.792016:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915893760 00000100:00100000:3.0:1784186478.792067:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 217 00000100:00100000:3.0:1784186478.792088:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:8114:x1870854915893760:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784186478.792329:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:8114:x1870854915893760:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 242us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186478.792338:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 217 00000100:00100000:2.0:1784186478.798376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186478.798480:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915893888 00000100:00100000:1.0:1784186478.798491:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915893888 00000100:00100000:1.0:1784186478.798541:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:1.0:1784186478.798549:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1870854915893888:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784186478.798580:0:7478:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 49150bba-27c4-40e0-9c9a-350e9b02ab4e@192.168.201.31@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:1.0:1784186478.798622:0:7478:0:(genops.c:1406:class_connect()) connect: client 49150bba-27c4-40e0-9c9a-350e9b02ab4e, cookie 0x55bc3e8c99d191ab 00000004:00100000:1.0:1784186478.798655:0:7478:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784186478.798954:0:7478:0:(import.c:65:import_set_state_nolock()) ffff9b9fc2e9c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784186478.799250:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:2353:x1870854915893888:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 698us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186478.799259:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1784186478.801608:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186478.801691:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915894272 00000100:00100000:3.0:1784186478.801700:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915894272 00000100:00100000:3.0:1784186478.801843:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:3.0:1784186478.801855:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915894272:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186478.801935:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915894272:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 82us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186478.801944:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00080000:1.0:1784186478.803591:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186478.812734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186478.812785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186478.812928:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915894144 00000100:00100000:1.0:1784186478.812938:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915894144 00000100:00100000:1.0:1784186478.813030:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915894016 00000100:00100000:1.0:1784186478.813034:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915894016 00000100:00100000:1.0:1784186478.813062:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:1.0:1784186478.813080:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+7:8107:x1870854915894144:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784186478.813131:0:7478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784186478.813218:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+7:8107:x1870854915894144:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 147us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186478.813227:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:1.0:1784186478.813249:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:1.0:1784186478.813256:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:0:x1870854915894016:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784186478.813267:0:7478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784186478.813290:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:0:x1870854915894016:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 35us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186478.813297:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00080000:2.0:1784186478.813572:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186478.817189:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186478.817384:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915894400 00000100:00100000:1.0:1784186478.817393:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915894400 00000100:00100000:1.0:1784186478.817527:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:1.0:1784186478.817538:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:8107:x1870854915894400:12345-192.168.201.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784186478.817613:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:8107:x1870854915894400:12345-192.168.201.31@tcp:40:mount.lustre.0 Request processed in 78us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186478.817636:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:2.0:1784186478.819529:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186478.819569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186478.819599:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186478.819628:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915894528 00000100:00100000:2.0:1784186478.819635:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915894528 00000100:00100000:2.0:1784186478.819665:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915894656 00000100:00100000:2.0:1784186478.819668:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915894656 00000100:00100000:2.0:1784186478.819680:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:2.0:1784186478.819687:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1870854915894528:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784186478.819714:0:6583:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 49150bba-27c4-40e0-9c9a-350e9b02ab4e@192.168.201.31@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1784186478.819741:0:6583:0:(genops.c:1406:class_connect()) connect: client 49150bba-27c4-40e0-9c9a-350e9b02ab4e, cookie 0x55bc3e8c99d191b2 00002000:00100000:2.0:1784186478.820025:0:6583:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 49150bba-27c4-40e0-9c9a-350e9b02ab4e/ffff9b9ffeda5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784186478.820062:0:6583:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784186478.820271:0:6583:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784186478.820298:0:6583:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeda3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784186478.820357:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:2353:x1870854915894528:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 669us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186478.820365:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:2.0:1784186478.820386:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:2.0:1784186478.820390:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1870854915894656:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784186478.820406:0:6583:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 49150bba-27c4-40e0-9c9a-350e9b02ab4e@192.168.201.31@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1784186478.820422:0:6583:0:(genops.c:1406:class_connect()) connect: client 49150bba-27c4-40e0-9c9a-350e9b02ab4e, cookie 0x55bc3e8c99d191b9 00002000:00100000:2.0:1784186478.820427:0:6583:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 49150bba-27c4-40e0-9c9a-350e9b02ab4e/ffff9b9ffeda0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784186478.820468:0:6583:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784186478.820675:0:6583:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784186478.820687:0:6583:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeda6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784186478.820705:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:2353:x1870854915894656:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 314us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186478.820710:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:2.0:1784186478.820729:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915894784 00000100:00100000:2.0:1784186478.820733:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915894784 00000100:00100000:3.0:1784186478.820838:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:3.0:1784186478.820845:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:8107:x1870854915894784:12345-192.168.201.31@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784186478.821000:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784186478.821116:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:8107:x1870854915894784:12345-192.168.201.31@tcp:33:mount.lustre.0 Request processed in 272us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186478.821126:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00010000:00010000:0.0:1784186479.679196:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186480.702137:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186480.832817:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784186480.832838:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937947648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784186480.832917:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186480.832989:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937947648 00000100:00100000:3.0:1784186480.832996:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937947648 00000100:00100000:3.0:1784186480.833049:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784186480.833058:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937947648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784186480.833094:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186480.833141:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937947648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186480.833148:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1784186480.833183:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784186480.833211:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fd11b5500 x1870854937947648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186480.833230:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937947648:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784186481.725666:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186481.853913:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784186481.854086:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937947904:0@lo:400:kworker.0 00000100:00100000:3.0:1784186481.854162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186481.854225:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186481.854232:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937948032:0@lo:400:kworker.0 00000100:00100000:3.0:1784186481.854255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186481.854291:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937947904 00000100:00100000:3.0:1784186481.854297:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937947904 00000100:00100000:3.0:1784186481.854338:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937948032 00000100:00100000:3.0:1784186481.854340:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937948032 00000100:00100000:3.0:1784186481.854369:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784186481.854389:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937947904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186481.854465:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937947904:12345-0@lo:400:kworker.0 Request processed in 49us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186481.854473:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784186481.854617:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784186481.854623:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937948032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186481.854650:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937948032:12345-0@lo:400:kworker.0 Request processed in 28us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186481.854655:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1784186481.854676:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186481.854717:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937948032:0@lo:400:kworker.0 00000100:00100000:3.0:1784186481.854726:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937947904:0@lo:400:kworker.0 00000100:00100000:2.0:1784186481.854928:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937948160:0@lo:400:kworker.0 00000100:00100000:2.0:1784186481.854973:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186481.855006:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937947776:0@lo:400:kworker.0 00000100:00100000:2.0:1784186481.855030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186481.855136:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937948160 00000100:00100000:3.0:1784186481.855140:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937948160 00000100:00100000:3.0:1784186481.855173:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784186481.855179:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937948160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186481.855215:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937948160:12345-0@lo:400:kworker.0 Request processed in 37us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186481.855221:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1784186481.855249:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ec7297b80 x1870854937948160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186481.855259:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937948160:0@lo:400:kworker.0 00000100:00100000:0.0:1784186481.855338:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937947776 00000100:00100000:0.0:1784186481.855342:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937947776 00000100:00100000:0.0:1784186481.855375:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1784186481.855381:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937947776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186481.855613:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937947776:12345-0@lo:400:kworker.0 Request processed in 231us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186481.855621:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1784186481.855792:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937948416:0@lo:400:kworker.0 00000100:00100000:0.0:1784186481.855819:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186481.855872:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937948288:0@lo:400:kworker.0 00000100:00100000:3.0:1784186481.855900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186481.855954:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937948288 00000100:00100000:3.0:1784186481.855958:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937948288 00000100:00100000:3.0:1784186481.855992:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784186481.855999:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937948288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186481.856034:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937948288:12345-0@lo:400:kworker.0 Request processed in 35us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186481.856039:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1784186481.856061:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186481.856079:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937948288:0@lo:400:kworker.0 00000100:00100000:3.0:1784186481.858282:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937948416 00000100:00100000:3.0:1784186481.858297:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937948416 00000100:00100000:3.0:1784186481.858367:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784186481.858377:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937948416:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784186481.858498:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784186481.858601:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe87e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937947776:0@lo:400:kworker.0 00000100:00100000:3.0:1784186481.861881:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937948416:12345-0@lo:400:kworker.0 Request processed in 3493us (6047us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186481.861896:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1784186481.862252:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ec7295180 x1870854937948416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186481.862268:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937948416:0@lo:400:kworker.0 00000100:00100000:0.0:1784186482.365912:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784186482.365971:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937948544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186482.366037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186482.366098:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937948544 00000100:00100000:3.0:1784186482.366108:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937948544 00000100:00100000:3.0:1784186482.366167:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784186482.366191:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937948544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784186482.366251:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186482.366314:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937948544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186482.366322:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1784186482.368222:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe063800 x1870854937948544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186482.368251:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937948544:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1784186482.418504:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49150bba-27c4-40e0-9c9a-350e9b02ab4e 00010000:00010000:1.0:1784186482.750311:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186483.775722:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784186483.956993:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 49150bba-27c4-40e0-9c9a-350e9b02ab4e 00000001:02000400:3.0:1784186483.974024:0:10151:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:3.0:1784186483.995281:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49150bba-27c4-40e0-9c9a-350e9b02ab4e 00000100:00100000:3.0:1784186484.083111:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186484.083166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186484.083190:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186484.083210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186484.083238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186484.083268:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915895040 00000100:00100000:3.0:1784186484.083277:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915895040 00000100:00100000:3.0:1784186484.083333:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915895168 00000100:00100000:3.0:1784186484.083336:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915895168 00000100:00100000:3.0:1784186484.083359:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:3.0:1784186484.083371:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915895040:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186484.083468:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915895040:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186484.083476:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:3.0:1784186484.083506:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:3.0:1784186484.083512:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2356:x1870854915895168:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186484.083538:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2356:x1870854915895168:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186484.083544:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00080000:3.0:1784186484.083565:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186484.083710:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915894912 00000100:00100000:0.0:1784186484.083715:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915894912 00000100:00100000:0.0:1784186484.083755:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 219 00000100:00100000:0.0:1784186484.083763:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915894912:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186484.083803:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915894912:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 41us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186484.083810:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 219 00000100:00100000:0.0:1784186484.085043:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915895296 00000100:00100000:0.0:1784186484.085054:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915895296 00000100:00100000:0.0:1784186484.085096:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915895424 00000100:00100000:0.0:1784186484.085099:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915895424 00000100:00100000:0.0:1784186484.085116:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:0.0:1784186484.085123:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915895296:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186484.085176:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915895296:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 54us (1964us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186484.085183:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:0.0:1784186484.085199:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:0.0:1784186484.085205:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2356:x1870854915895424:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186484.085228:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2356:x1870854915895424:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 23us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186484.085234:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00080000:3.0:1784186484.086037:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784186484.086043:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784186484.797842:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186485.826006:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186485.957695:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937948672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784186485.957798:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186485.958164:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937948672 00000100:00100000:1.0:1784186485.958173:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937948672 00000100:00100000:1.0:1784186485.958251:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784186485.958262:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937948672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784186485.958302:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1784186485.985510:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784186485.987511:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937948672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 29239us (29700us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186485.987525:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1784186485.991681:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe061500 x1870854937948672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186485.991752:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937948672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784186486.845617:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186486.975683:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937948800:0@lo:400:kworker.0 00000100:00100000:3.0:1784186486.975755:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186486.975799:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937949312:0@lo:400:kworker.0 00000100:00100000:3.0:1784186486.975827:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186486.975861:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784186486.975868:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937949184:0@lo:400:kworker.0 00000100:00100000:3.0:1784186486.975895:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186486.975924:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe313100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937949056:0@lo:400:kworker.0 00000100:00100000:3.0:1784186486.976071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186486.976092:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784186486.976098:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937948928:0@lo:400:kworker.0 00000100:00100000:3.0:1784186486.976120:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186486.976189:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937949440:0@lo:400:kworker.0 00000100:00100000:3.0:1784186486.976219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186486.976249:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937948800 00000100:00100000:3.0:1784186486.976257:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937948800 00000100:00100000:3.0:1784186486.976302:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1784186486.976312:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937948800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186486.976361:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937948800:12345-0@lo:400:kworker.0 Request processed in 50us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186486.976369:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1784186486.976413:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937949312 00000100:00100000:3.0:1784186486.976417:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937949312 00000100:00100000:3.0:1784186486.978036:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937949056 00000100:00100000:3.0:1784186486.978047:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937949056 00000100:00100000:0.0:1784186486.986968:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937948928 00000100:00100000:0.0:1784186486.986982:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937948928 00000100:00100000:0.0:1784186486.987027:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784186486.987036:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937949312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186486.987123:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937949312:12345-0@lo:400:kworker.0 Request processed in 89us (11295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186486.987130:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784186486.987168:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784186486.987174:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937949056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186486.987213:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937949056:12345-0@lo:400:kworker.0 Request processed in 40us (11142us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186486.987219:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784186486.987230:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784186486.987236:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937948928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186486.987257:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937948928:12345-0@lo:400:kworker.0 Request processed in 22us (11137us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186486.987262:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784186486.987392:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937948928:0@lo:400:kworker.0 00000100:00100000:1.0:1784186486.987404:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe313100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937949056:0@lo:400:kworker.0 00000100:00100000:0.0:1784186486.988054:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937949184 00000100:00100000:0.0:1784186486.988062:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937949184 00000100:00100000:0.0:1784186486.988101:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937949440 00000100:00100000:0.0:1784186486.988104:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937949440 00000100:00100000:0.0:1784186486.988121:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784186486.988127:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937949184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186486.988174:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937949184:12345-0@lo:400:kworker.0 Request processed in 47us (12278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186486.988179:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784186486.988191:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784186486.988195:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdbc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937949440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186486.988219:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdbc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937949440:12345-0@lo:400:kworker.0 Request processed in 24us (12000us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186486.988224:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1784186486.988699:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe310380 x1870854937949440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186486.988715:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937949440:0@lo:400:kworker.0 00000100:00080000:2.0:1784186486.989588:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784186486.989595:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784186486.989629:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe311180 x1870854937949184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186486.989642:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937949184:0@lo:400:kworker.0 00000100:00100000:2.0:1784186486.989652:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937948800:0@lo:400:kworker.0 00000100:00100000:2.0:1784186486.989663:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937949312:0@lo:400:kworker.0 00000100:00100000:1.0:1784186487.487161:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937949568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186487.487243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186487.488402:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937949568 00000100:00100000:0.0:1784186487.488416:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937949568 00000100:00100000:0.0:1784186487.488503:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784186487.488524:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937949568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186487.488566:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186487.488641:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937949568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186487.488649:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1784186487.490537:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe063100 x1870854937949568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186487.490565:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937949568:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784186487.869800:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186488.893589:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186489.170380:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186489.170425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186489.170480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186489.170499:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186489.170522:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186489.170551:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915895808 00000100:00100000:3.0:1784186489.170561:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915895808 00000100:00100000:3.0:1784186489.170611:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915895680 00000100:00100000:3.0:1784186489.170614:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915895680 00000100:00100000:3.0:1784186489.170637:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:3.0:1784186489.170646:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915895808:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186489.170721:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915895808:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 77us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186489.170730:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:3.0:1784186489.170751:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:3.0:1784186489.170757:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915895680:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186489.170781:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915895680:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186489.170787:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:3.0:1784186489.170807:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915896064 00000100:00100000:3.0:1784186489.170811:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915896064 00000100:00100000:3.0:1784186489.170851:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915895936 00000100:00100000:3.0:1784186489.170855:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915895936 00000100:00100000:3.0:1784186489.170871:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:3.0:1784186489.170878:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915896064:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186489.170931:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915896064:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 53us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186489.170938:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:3.0:1784186489.170955:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:3.0:1784186489.170961:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915895936:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186489.170985:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915895936:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 24us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186489.170990:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:1.0:1784186489.171366:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915895552 00000100:00100000:1.0:1784186489.171371:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915895552 00000100:00100000:1.0:1784186489.171401:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 221 00000100:00100000:1.0:1784186489.171408:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2357:x1870854915895552:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186489.171462:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2357:x1870854915895552:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 54us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186489.171469:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 221 00000100:00080000:2.0:1784186489.172204:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784186489.172210:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784186489.172213:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784186489.920363:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186490.941694:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186491.070163:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784186491.070186:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937949696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784186491.070254:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186491.070326:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937949696 00000100:00100000:3.0:1784186491.070334:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937949696 00000100:00100000:3.0:1784186491.070394:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784186491.070403:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937949696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784186491.070457:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186491.070502:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937949696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186491.070509:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1784186491.070531:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784186491.070575:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe313800 x1870854937949696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186491.070592:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937949696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784186491.965873:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186492.095063:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937949824:0@lo:400:kworker.0 00000100:00100000:2.0:1784186492.095138:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186492.095257:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784186492.095264:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937950208:0@lo:400:kworker.0 00000100:00100000:2.0:1784186492.095293:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186492.095308:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937949952:0@lo:400:kworker.0 00000100:00100000:2.0:1784186492.095327:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937949824 00000100:00100000:2.0:1784186492.095333:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937949824 00000100:00100000:1.0:1784186492.095338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186492.095357:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186492.095362:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937950080:0@lo:400:kworker.0 00000100:00100000:1.0:1784186492.095382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186492.095388:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1784186492.095397:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937949824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186492.095409:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937949952 00000100:00100000:1.0:1784186492.095412:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937949952 00000100:00100000:1.0:1784186492.095437:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937950080 00000100:00100000:1.0:1784186492.095458:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937950080 00000100:00100000:2.0:1784186492.095459:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937949824:12345-0@lo:400:kworker.0 Request processed in 64us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186492.095466:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784186492.095486:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784186492.095491:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937949952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186492.095514:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937949824:0@lo:400:kworker.0 00000100:00100000:1.0:1784186492.095525:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937949952:12345-0@lo:400:kworker.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186492.095530:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784186492.095552:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784186492.095558:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937950080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186492.095585:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937950080:12345-0@lo:400:kworker.0 Request processed in 27us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186492.095591:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1784186492.095612:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186492.095634:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937950080:0@lo:400:kworker.0 00000100:00100000:1.0:1784186492.095642:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937949952:0@lo:400:kworker.0 00000100:00100000:3.0:1784186492.095955:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937950208 00000100:00100000:3.0:1784186492.095967:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937950208 00000100:00100000:3.0:1784186492.095997:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784186492.096005:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937950208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186492.096054:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937950208:12345-0@lo:400:kworker.0 Request processed in 50us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186492.096061:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1784186492.096229:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe062d80 x1870854937950208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186492.096240:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937950208:0@lo:400:kworker.0 00000100:00100000:2.0:1784186492.098288:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937950336:0@lo:400:kworker.0 00000100:00100000:2.0:1784186492.098722:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186492.098936:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937950464:0@lo:400:kworker.0 00000100:00100000:1.0:1784186492.098973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186492.099060:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937950464 00000100:00100000:0.0:1784186492.099068:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937950464 00000100:00100000:0.0:1784186492.099122:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784186492.099132:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937950464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186492.099191:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937950464:12345-0@lo:400:kworker.0 Request processed in 60us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186492.099199:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1784186492.099219:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784186492.099248:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe062d80 x1870854937950464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186492.099263:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937950464:0@lo:400:kworker.0 00000100:00100000:3.0:1784186492.099315:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937950336 00000100:00100000:3.0:1784186492.099320:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937950336 00000100:00100000:3.0:1784186492.099404:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784186492.099412:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937950336:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784186492.099517:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186492.099713:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937950336:12345-0@lo:400:kworker.0 Request processed in 302us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186492.099720:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784186492.099825:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937950336:0@lo:400:kworker.0 00000100:00100000:3.0:1784186492.607029:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186492.607051:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937950592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784186492.607116:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186492.607194:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937950592 00000100:00100000:3.0:1784186492.607201:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937950592 00000100:00100000:3.0:1784186492.607244:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784186492.607252:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937950592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784186492.607283:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186492.607322:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937950592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186492.607328:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1784186492.607375:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe313800 x1870854937950592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186492.607392:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937950592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784186492.999112:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186494.015701:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186494.298463:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186494.298499:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186494.298525:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186494.298544:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186494.298568:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186494.298607:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915896192 00000100:00100000:2.0:1784186494.298617:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915896192 00000100:00100000:2.0:1784186494.298665:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 223 00000100:00100000:2.0:1784186494.298675:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915896192:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186494.298758:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915896192:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 83us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186494.298766:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 223 00000100:00100000:2.0:1784186494.298799:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915896448 00000100:00100000:2.0:1784186494.298802:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915896448 00000100:00100000:2.0:1784186494.298836:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915896320 00000100:00100000:2.0:1784186494.298838:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915896320 00000100:00100000:2.0:1784186494.298858:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:2.0:1784186494.298865:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915896448:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186494.298896:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915896448:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186494.298903:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:2.0:1784186494.298915:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:2.0:1784186494.298933:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915896320:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186494.298960:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915896320:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186494.298966:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:2.0:1784186494.298983:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915896704 00000100:00100000:2.0:1784186494.298986:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915896704 00000100:00100000:2.0:1784186494.299011:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915896576 00000100:00100000:2.0:1784186494.299014:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915896576 00000100:00100000:2.0:1784186494.299029:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:2.0:1784186494.299036:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915896704:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186494.299061:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915896704:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186494.299068:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:2.0:1784186494.299080:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:2.0:1784186494.299085:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915896576:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186494.299110:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915896576:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186494.299116:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00080000:2.0:1784186494.299256:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784186494.299260:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784186494.299263:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784186495.038065:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186496.062054:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186496.190743:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937950720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186496.190821:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186496.190873:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937950720 00000100:00100000:0.0:1784186496.190881:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937950720 00000100:00100000:0.0:1784186496.190953:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784186496.190963:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937950720:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784186496.190992:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1784186496.190998:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186496.191056:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937950720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186496.191062:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1784186496.191116:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe062d80 x1870854937950720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186496.191135:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937950720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784186497.089566:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186497.215544:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937950976:0@lo:400:kworker.0 00000100:00100000:3.0:1784186497.215625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186497.215675:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937951488:0@lo:400:kworker.0 00000100:00100000:3.0:1784186497.215711:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186497.215744:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186497.215750:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937951104:0@lo:400:kworker.0 00000100:00100000:3.0:1784186497.215796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186497.215833:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937950976 00000100:00100000:3.0:1784186497.215840:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937950976 00000100:00100000:3.0:1784186497.215884:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937951104 00000100:00100000:3.0:1784186497.215887:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937951104 00000100:00100000:3.0:1784186497.215919:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784186497.215927:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937950976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186497.215985:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937950976:12345-0@lo:400:kworker.0 Request processed in 58us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186497.215992:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784186497.216029:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784186497.216035:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937951104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186497.216061:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937951104:12345-0@lo:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186497.216067:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784186497.216091:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937951488 00000100:00100000:3.0:1784186497.216095:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937951488 00000100:00100000:3.0:1784186497.216122:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784186497.216136:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937951488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186497.216167:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937951488:12345-0@lo:400:kworker.0 Request processed in 32us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186497.216173:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784186497.216228:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937951104:0@lo:400:kworker.0 00000100:00100000:3.0:1784186497.216240:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937950976:0@lo:400:kworker.0 00010000:00080000:3.0:1784186497.216252:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe310e00 x1870854937951488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186497.216262:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937951488:0@lo:400:kworker.0 00000100:00100000:0.0:1784186497.216414:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937950848:0@lo:400:kworker.0 00000100:00100000:0.0:1784186497.216466:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186497.216492:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937951360:0@lo:400:kworker.0 00000100:00100000:0.0:1784186497.216515:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186497.216531:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784186497.216536:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937951232:0@lo:400:kworker.0 00000100:00100000:0.0:1784186497.216557:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186497.216583:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937951232 00000100:00100000:0.0:1784186497.216587:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937951232 00000100:00100000:0.0:1784186497.216611:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784186497.216618:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937951232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186497.216654:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937951232:12345-0@lo:400:kworker.0 Request processed in 36us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186497.216660:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1784186497.216697:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe311180 x1870854937951232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186497.216706:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937951232:0@lo:400:kworker.0 00000100:00100000:3.0:1784186497.216764:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937950848 00000100:00100000:3.0:1784186497.216768:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937950848 00000100:00100000:3.0:1784186497.219780:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1784186497.219801:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937950848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186497.219909:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937950848:12345-0@lo:400:kworker.0 Request processed in 116us (3442us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186497.219917:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1784186497.220066:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186497.220072:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186497.220375:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937950848:0@lo:400:kworker.0 00000100:00100000:3.0:1784186497.220406:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937951360 00000100:00100000:3.0:1784186497.220413:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937951360 00000100:00100000:3.0:1784186497.220500:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784186497.220506:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937951360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186497.220549:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937951360:12345-0@lo:400:kworker.0 Request processed in 43us (4033us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186497.220556:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784186497.220601:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937951360:0@lo:400:kworker.0 00000100:00080000:1.0:1784186497.220681:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186497.726609:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937951616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186497.726696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186497.726952:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937951616 00000100:00100000:2.0:1784186497.726960:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937951616 00000100:00100000:2.0:1784186497.727024:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784186497.727034:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937951616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784186497.727073:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186497.729646:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937951616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2605us (2941us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186497.729660:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1784186497.734386:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc2e68000 x1870854937951616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186497.734415:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937951616:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784186498.111277:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186499.135703:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186499.409780:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186499.411237:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186499.411292:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186499.411317:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186499.411394:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186499.411426:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915897216 00000100:00100000:0.0:1784186499.411436:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915897216 00000100:00100000:3.0:1784186499.411781:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915897088 00000100:00100000:3.0:1784186499.411795:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915897088 00000100:00100000:3.0:1784186499.411834:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915896960 00000100:00100000:3.0:1784186499.411837:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915896960 00000100:00100000:3.0:1784186499.411861:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:3.0:1784186499.411872:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2355:x1870854915897088:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186499.411930:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915897344 00000100:00100000:0.0:1784186499.411935:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915897344 00000100:00100000:3.0:1784186499.411961:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2355:x1870854915897088:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 89us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186499.411965:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:3.0:1784186499.411978:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:0.0:1784186499.411980:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2353:x1870854915897216:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:0.0:1784186499.412005:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d191b2 00000100:00080000:0.0:1784186499.412014:0:6584:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeda3000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784186499.412019:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 83 00000100:00100000:3.0:1784186499.412029:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2355:x1870854915896960:12345-192.168.201.31@tcp:400:kworker.0 00000001:00000004:0.0:1784186499.412057:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1784186499.412058:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2355:x1870854915896960:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 30us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186499.412067:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 83 00000100:00080000:3.0:1784186499.412209:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784186499.412215:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784186499.412217:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784186499.412733:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186499.413902:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+2:2353:x1870854915897216:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 1916us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186499.413916:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:0.0:1784186499.413947:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:0.0:1784186499.413957:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2353:x1870854915897344:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:0.0:1784186499.413983:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d191b9 00000100:00080000:0.0:1784186499.413995:0:6584:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeda6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784186499.414101:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784186499.414373:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915896832 00000100:00100000:2.0:1784186499.414381:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915896832 00000100:00100000:0.0:1784186499.414384:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+2:2353:x1870854915897344:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 430us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186499.414390:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:2.0:1784186499.414433:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 225 00000100:00100000:2.0:1784186499.414457:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2355:x1870854915896832:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186499.414488:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2355:x1870854915896832:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 48us (4719us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186499.414507:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 225 00010000:00010000:1.0:1784186499.416325:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186500.158904:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784186500.516754:0:10852:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1784186501.182208:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186501.309735:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937951744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186501.309826:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186501.310350:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937951744 00000100:00100000:0.0:1784186501.310359:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937951744 00000100:00100000:0.0:1784186501.310435:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784186501.310479:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937951744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784186501.310529:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186501.310583:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7295180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937951744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186501.310591:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1784186501.311558:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784186501.311605:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe062a00 x1870854937951744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186517 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186501.311641:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937951744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784186502.208294:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186502.334256:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937952000:0@lo:400:kworker.0 00000100:00100000:3.0:1784186502.334342:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186502.334398:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937952512:0@lo:400:kworker.0 00000100:00100000:3.0:1784186502.334425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186502.334483:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186502.334490:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937952128:0@lo:400:kworker.0 00000100:00100000:3.0:1784186502.334513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186502.334544:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937952000 00000100:00100000:3.0:1784186502.334563:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937952000 00000100:00100000:0.0:1784186502.335418:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937951872:0@lo:400:kworker.0 00000100:00100000:0.0:1784186502.335479:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186502.335512:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937952384:0@lo:400:kworker.0 00000100:00100000:0.0:1784186502.335536:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186502.335562:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784186502.335568:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937952256:0@lo:400:kworker.0 00000100:00100000:0.0:1784186502.335620:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186502.335657:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937951872 00000100:00100000:0.0:1784186502.335663:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937951872 00000100:00100000:0.0:1784186502.335717:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784186502.335727:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937951872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186502.335785:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937951872:12345-0@lo:400:kworker.0 Request processed in 59us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186502.335793:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1784186502.335824:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937952128 00000100:00100000:0.0:1784186502.335828:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937952128 00000100:00100000:0.0:1784186502.335864:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937952384 00000100:00100000:0.0:1784186502.335867:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937952384 00000100:00100000:0.0:1784186502.335881:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784186502.335887:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937952128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186502.335926:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937952128:12345-0@lo:400:kworker.0 Request processed in 39us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186502.335955:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1784186502.335969:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784186502.335975:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937952384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186502.336005:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937952384:12345-0@lo:400:kworker.0 Request processed in 31us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186502.336011:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1784186502.336028:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937952512 00000100:00100000:0.0:1784186502.336032:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937952512 00000100:00100000:0.0:1784186502.336058:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937952256 00000100:00100000:0.0:1784186502.336061:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937952256 00000100:00100000:0.0:1784186502.336075:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784186502.336081:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937952512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186502.336111:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937952512:12345-0@lo:400:kworker.0 Request processed in 31us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186502.336117:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784186502.336128:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784186502.336134:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937952256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186502.336162:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937952256:12345-0@lo:400:kworker.0 Request processed in 28us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186502.336183:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1784186502.336222:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc2e68700 x1870854937952256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186502.336237:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937952256:0@lo:400:kworker.0 00000100:00100000:0.0:1784186502.336249:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937951872:0@lo:400:kworker.0 00000100:00100000:0.0:1784186502.336259:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937952384:0@lo:400:kworker.0 00000100:00080000:0.0:1784186502.336294:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784186502.336299:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186502.336327:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937952128:0@lo:400:kworker.0 00010000:00080000:0.0:1784186502.336341:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc2e6b800 x1870854937952512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186502.336351:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937952512:0@lo:400:kworker.0 00000100:00100000:3.0:1784186502.336967:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784186502.336977:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937952000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186502.337030:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937952000:12345-0@lo:400:kworker.0 Request processed in 55us (2688us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186502.337036:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784186502.337386:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937952000:0@lo:400:kworker.0 00000100:00100000:0.0:1784186502.845978:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784186502.846003:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937952640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186502.846074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186502.846159:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937952640 00000100:00100000:0.0:1784186502.846167:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937952640 00000100:00100000:0.0:1784186502.846215:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784186502.846225:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937952640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186502.846263:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186502.846307:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937952640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186502.846314:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1784186502.846358:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffe062d80 x1870854937952640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186502.846377:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937952640:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1784186502.926919:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49150bba-27c4-40e0-9c9a-350e9b02ab4e 00000020:00000080:0.0:1784186502.926929:0:7480:0:(genops.c:906:class_export_put()) final put ffff9b9ffeda0800/49150bba-27c4-40e0-9c9a-350e9b02ab4e 00000020:00000080:2.0:1784186502.926990:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffeda0800/49150bba-27c4-40e0-9c9a-350e9b02ab4e for lustre-OST0001 00000020:00000080:2.0:1784186502.929871:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ffeda6000 for lustre-OST0001 00010000:00010000:2.0:1784186503.230535:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186504.253964:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784186504.286398:0:11001:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc01c46150 20000000:00000080:2.0:1784186504.286414:0:11001:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b9ffe299c00 uarg=0000000000000000 20000000:01000000:2.0:1784186504.286478:0:11001:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784186504.286484:0:11001:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1784186504.286489:0:11001:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784186504.289081:0:11002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1784186504.289197:0:11001:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784186504.295014:0:11001:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784186504.295051:0:11001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186504.295267:0:11001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d19165 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576408 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186504.295278:0:11001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19173 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1916c expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186504.295285:0:11001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc9128a00/0x55bc3e8c99d19181 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1917a expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186504.295291:0:11001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d1918f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19188 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186504.295298:0:11001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc27ed800/0x55bc3e8c99d191a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576440 expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186504.295306:0:11001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.295979:0:11001:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc27ed800/0x55bc3e8c99d191a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576440 expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.296006:0:11001:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9fc27ed800/0x55bc3e8c99d191a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576440 expref: 12 pid: 5775 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186504.296022:0:11001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11001:1870854937952768:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186504.296334:0:11001:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d1918f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d19188 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.296344:0:11001:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d1918f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d19188 expref: 18 pid: 5777 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186504.296353:0:11001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd541880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11001:1870854937952896:0@lo:104: 00000100:00100000:0.0:1784186504.296397:0:11001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784186504.296474:0:11001:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc9128a00/0x55bc3e8c99d19181 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d1917a expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.296485:0:11001:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fc9128a00/0x55bc3e8c99d19181 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d1917a expref: 18 pid: 5775 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186504.296493:0:11001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11001:1870854937953024:0@lo:104: 00000100:00100000:0.0:1784186504.296514:0:11001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784186504.296539:0:11001:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19173 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d1916c expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186504.296668:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937952896 00000100:00100000:1.0:1784186504.296675:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937952896 00000100:00100000:1.0:1784186504.296715:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937953024 00000100:00100000:1.0:1784186504.296718:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937953024 00000100:00100000:1.0:1784186504.296731:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784186504.296739:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+4:11001:x1870854937952896:12345-0@lo:104: 00010000:00010000:1.0:1784186504.296753:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186504.296799:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784186504.296805:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+4:11001:x1870854937952896:12345-0@lo:104: Request processed in 67us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186504.296813:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784186504.296836:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784186504.296842:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+3:11001:x1870854937953024:12345-0@lo:104: 00010000:00010000:1.0:1784186504.296849:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186504.296887:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784186504.296891:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+3:11001:x1870854937953024:12345-0@lo:104: Request processed in 50us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186504.296897:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1784186504.297022:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784186504.297029:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.297036:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129600 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:2.0:1784186504.297040:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.297049:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186504.297068:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186504.297074:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784186504.297113:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.297119:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784186504.297152:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.297159:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc9129600/0x55bc3e8c99d19188 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1918f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.297175:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186504.297178:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.297183:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128200 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:2.0:1784186504.297186:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.297192:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186504.297198:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186504.297203:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784186504.297222:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.297227:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784186504.297234:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.297239:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d1917a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19181 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.297249:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186504.297250:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186504.297252:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186504.297258:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186504.297270:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937953280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784186504.297304:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186504.297328:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784186504.297334:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937953408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784186504.297354:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186504.297384:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937953280 00000100:00100000:2.0:1784186504.297389:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937953280 00010000:00010000:2.0:1784186504.297409:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d1918f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d19188 expref: 19 pid: 5777 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186504.297428:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937953408 00000100:00100000:2.0:1784186504.297431:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937953408 00010000:00010000:2.0:1784186504.297463:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc9128a00/0x55bc3e8c99d19181 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1917a expref: 20 pid: 5775 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186504.297478:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784186504.297484:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe55b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+20:3308:x1870854937953280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784186504.297501:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186504.297507:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d1918f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d19188 expref: 20 pid: 5777 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.297564:0:11001:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19173 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d1916c expref: 20 pid: 5775 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186504.297584:0:11001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11001:1870854937953152:0@lo:104: 00000100:00100000:0.0:1784186504.297611:0:11001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186504.297746:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937953152 00000100:00100000:1.0:1784186504.297750:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937953152 00000100:00100000:1.0:1784186504.297774:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784186504.297780:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+3:11001:x1870854937953152:12345-0@lo:104: 00010000:00010000:1.0:1784186504.297788:0:5765:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186504.297825:0:5765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784186504.297830:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+3:11001:x1870854937953152:12345-0@lo:104: Request processed in 51us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186504.297836:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784186504.298066:0:5767:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784186504.298080:0:5767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1784186504.298111:0:5769:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784186504.298120:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784186504.298126:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6759c-e30b-4013-88b9-0b4d132afa93+20:3308:x1870854937953408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186504.299924:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186504.299942:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc9128a00/0x55bc3e8c99d19181 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1917a expref: 20 pid: 5775 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.300033:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d1918f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d19188 expref: 20 pid: 5777 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.300058:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186504.300309:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe55b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+20:3308:x1870854937953280:12345-0@lo:103:ldlm_bl.0 Request processed in 2823us (3002us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186504.300318:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1784186504.300399:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186504.300406:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.300415:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17800 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:2.0:1784186504.300419:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.300428:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186504.300436:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186504.300464:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784186504.300496:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.300502:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784186504.300538:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186504.301315:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937953280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784186504.302411:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17800/0x55bc3e8c99d1916c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d19173 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186504.302502:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186504.302505:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186504.302508:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186504.302534:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937953536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784186504.302621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784186504.302841:0:11001:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d19165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576408 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.302855:0:11001:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d19165 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576408 expref: 12 pid: 5777 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186504.302868:0:11001:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11001:1870854937953664:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186504.302930:0:5768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784186504.302941:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937953536 00000100:00100000:1.0:1784186504.302947:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937953536 00010000:00010000:1.0:1784186504.302975:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19173 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1916c expref: 20 pid: 5775 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186504.302996:0:5768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784186504.303003:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784186504.303017:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+20:3306:x1870854937953536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784186504.303042:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186504.303061:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19173 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1916c expref: 20 pid: 5775 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186504.303070:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19173 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d1916c expref: 20 pid: 5775 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186504.303102:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186504.303545:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc9128a00/0x55bc3e8c99d19181 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d1917a expref: 20 pid: 5775 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186504.303559:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186504.303674:0:11001:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffeea1180 going to sleep for 11 seconds 00010000:00010000:0.0:1784186504.303700:0:11001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27ece00/0x55bc3e8c99d1918f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d19188 expref: 20 pid: 5777 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186504.303714:0:11001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd541880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11001:1870854937952896:0@lo:104: 00010000:00010000:0.0:1784186504.303727:0:11001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9128a00/0x55bc3e8c99d19181 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d1917a expref: 19 pid: 5775 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186504.303735:0:11001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11001:1870854937953024:0@lo:104: 00010000:00010000:0.0:1784186504.303745:0:11001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19173 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d1916c expref: 18 pid: 5775 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186504.303754:0:11001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11001:1870854937953152:0@lo:104: 00000100:00100000:1.0:1784186504.303942:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:3306:x1870854937953536:12345-0@lo:103:ldlm_bl.0 Request processed in 924us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186504.303951:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784186504.304247:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937953536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784186504.304671:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186504.304696:0:5768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1784186504.304704:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915897472 00000100:00100000:0.0:1784186504.304710:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915897472 00010000:00010000:0.0:1784186504.304737:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc27ed800/0x55bc3e8c99d191a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576440 expref: 13 pid: 5775 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186504.304754:0:5768:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1784186504.304760:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:0.0:1784186504.304767:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915897472:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186504.304795:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186504.304801:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc27ed800/0x55bc3e8c99d191a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576440 expref: 13 pid: 5775 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.304811:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc27ed800/0x55bc3e8c99d191a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576440 expref: 13 pid: 5775 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.304828:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186504.304864:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915897472:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 97us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186504.304871:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00010000:00010000:2.0:1784186504.305298:0:11001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27ed800/0x55bc3e8c99d191a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576440 expref: 12 pid: 5775 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186504.305312:0:11001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11001:1870854937952768:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186504.305892:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6759c-e30b-4013-88b9-0b4d132afa93+16:3308:x1870854937953408:12345-0@lo:103:ldlm_bl.0 Request processed in 7762us (8533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186504.305902:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784186504.306219:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937953408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784186504.308233:0:11001:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11001:1870854937953664:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186504.308274:0:11001:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186504.308829:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186504.309745:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915897600 00000100:00100000:0.0:1784186504.309755:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915897600 00010000:00010000:0.0:1784186504.309799:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d19165 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576408 expref: 12 pid: 5777 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186504.309872:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:0.0:1784186504.309882:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:2357:x1870854915897600:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186504.309898:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186504.309904:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d19165 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576408 expref: 12 pid: 5777 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.309915:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d19165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576408 expref: 12 pid: 5777 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.309933:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d19165 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576408 expref: 12 pid: 5777 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.309949:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.309972:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.309989:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.309996:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.310002:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.310008:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.310014:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16e00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186504.310018:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.310036:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.310061:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186504.310072:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186504.310396:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:2357:x1870854915897600:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 255us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186504.310405:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00010000:00010000:3.0:1784186504.310494:0:11001:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186504.310502:0:11001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186504.310509:0:11001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf16e00/0x55bc3e8c99d191c0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1784186504.463142:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49150bba-27c4-40e0-9c9a-350e9b02ab4e 00000020:00000080:3.0:1784186504.463151:0:6607:0:(genops.c:906:class_export_put()) final put ffff9b9ffeda5800/49150bba-27c4-40e0-9c9a-350e9b02ab4e 00000020:00000080:0.0:1784186504.463234:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffeda5800/49150bba-27c4-40e0-9c9a-350e9b02ab4e for lustre-OST0000 00000020:00000080:0.0:1784186504.463288:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ffeda3000 for lustre-OST0000 00000100:00100000:0.0:1784186504.538718:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186504.538772:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186504.538798:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186504.538827:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915897984 00000100:00100000:0.0:1784186504.538838:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915897984 00000100:00100000:0.0:1784186504.538900:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915897856 00000100:00100000:0.0:1784186504.538904:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915897856 00000100:00100000:0.0:1784186504.538929:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 87 00000100:00100000:0.0:1784186504.538940:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2356:x1870854915897984:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186504.539082:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915897728 00000100:00100000:1.0:1784186504.539087:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915897728 00000100:00100000:1.0:1784186504.539121:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 227 00000100:00100000:1.0:1784186504.539128:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:2356:x1870854915897728:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186504.539173:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2356:x1870854915897984:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 235us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186504.539182:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 87 00000100:00100000:0.0:1784186504.539201:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 88 00000100:00100000:0.0:1784186504.539207:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2356:x1870854915897856:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186504.539396:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:2356:x1870854915897728:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 267us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186504.539403:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 227 00000100:00080000:1.0:1784186504.539482:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186504.539558:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2356:x1870854915897856:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 350us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186504.539577:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 88 00010000:00010000:2.0:1784186505.277694:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186505.490068:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186505.490144:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915898112 00000100:00100000:2.0:1784186505.490155:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915898112 00000100:00100000:2.0:1784186505.490213:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 228 00000100:00100000:2.0:1784186505.490224:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:5572:x1870854915898112:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784186505.490245:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186505.490275:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d191c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57646a expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186505.490308:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d191c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57646a expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186505.490320:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d191c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57646a expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186505.490330:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c600, rc 0) 00000100:00100000:2.0:1784186505.490392:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915898112:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 169us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186505.490399:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 228 00000100:00100000:0.0:1784186505.502415:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186505.502726:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915898240 00000100:00100000:1.0:1784186505.502737:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915898240 00000100:00100000:1.0:1784186505.502795:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 229 00000100:00100000:1.0:1784186505.502805:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915898240:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784186505.503112:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915898240:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 308us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186505.503120:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 229 00000100:00100000:1.0:1784186505.504956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186505.505014:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915898368 00000100:00100000:2.0:1784186505.505021:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915898368 00000100:00100000:2.0:1784186505.505065:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 230 00000100:00100000:2.0:1784186505.505073:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915898368:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784186505.505293:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915898368:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 220us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186505.505301:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 230 00000100:00100000:1.0:1784186505.514019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186505.514134:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915898496 00000100:00100000:0.0:1784186505.514145:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915898496 00000100:00100000:0.0:1784186505.514203:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 231 00000100:00100000:0.0:1784186505.514213:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915898496:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186505.514232:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186505.514250:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d191ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576471 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186505.514301:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d191ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576471 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186505.514313:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d191ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576471 expref: 13 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186505.514322:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128c00, rc 0) 00000100:00100000:0.0:1784186505.514393:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:5572:x1870854915898496:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 181us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186505.514400:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 231 00000100:00100000:3.0:1784186505.517991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186505.518107:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915898624 00000100:00100000:1.0:1784186505.518118:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915898624 00000100:00100000:1.0:1784186505.518226:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 232 00000100:00100000:1.0:1784186505.518236:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:5572:x1870854915898624:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784186505.518742:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:5572:x1870854915898624:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 506us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186505.518750:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 232 00000100:00100000:1.0:1784186505.521178:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186505.521268:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915898752 00000100:00100000:2.0:1784186505.521283:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915898752 00000100:00100000:2.0:1784186505.521346:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 233 00000100:00100000:2.0:1784186505.521368:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:5572:x1870854915898752:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784186505.521978:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:5572:x1870854915898752:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 610us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186505.521988:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 233 10000000:01000000:2.0:1784186505.985741:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784186505.985750:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc9c79000 from 7 10000000:01000000:2.0:1784186505.985755:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784186505.985808:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186505.985820:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186505.985831:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186505.985860:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937953792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784186505.985933:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186505.985993:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65540 going to sleep for 11 seconds 00000100:00100000:1.0:1784186505.986250:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937953792 00000100:00100000:1.0:1784186505.986258:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937953792 00000100:00100000:1.0:1784186505.986317:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1784186505.986326:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937953792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784186505.986340:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186505.986353:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d191dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d191d5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186505.986376:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d191dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d191d5 expref: 17 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186505.986386:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d191dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d191d5 expref: 17 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186505.986395:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27eda00, rc 0) 00000100:00100000:1.0:1784186505.986474:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937953792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186505.986482:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1784186505.986610:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937953792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186505.986627:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186505.986637:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186505.986702:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937953920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186505.986731:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186505.986757:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffeea1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784186505.986771:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937953920 00000100:00100000:0.0:1784186505.986774:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937953920 00000100:00100000:0.0:1784186505.995422:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1784186505.995463:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937953920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186505.995820:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937953920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 384us (9085us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186505.995840:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1784186505.996261:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937953920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186505.996321:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186505.996420:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186505.996484:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc913de40 going to sleep for 11 seconds 00000100:00100000:2.0:1784186505.996579:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937954048 00000100:00100000:2.0:1784186505.996586:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937954048 00000100:00100000:2.0:1784186505.996632:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1784186505.996640:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937954048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784186505.996807:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937954048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186505.996815:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1784186505.997403:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784186506.003430:0:11059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784186506.003735:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784186506.003758:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784186506.003770:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186506.003783:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186506.003817:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784186506.003820:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9ffef01800 from 7 10000000:01000000:2.0:1784186506.003822:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784186506.003861:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186506.003869:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186506.003880:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186506.003905:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784186506.003974:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186506.004023:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784186506.004034:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937954176 00000100:00100000:0.0:1784186506.004042:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937954176 00000100:00100000:0.0:1784186506.004092:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1784186506.004110:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937954176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186506.004124:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186506.004136:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9128800/0x55bc3e8c99d191ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d191e3 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186506.004170:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9128800/0x55bc3e8c99d191ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d191e3 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186506.004180:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9128800/0x55bc3e8c99d191ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d191e3 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186506.004189:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128800, rc 0) 00000100:00100000:0.0:1784186506.004230:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937954176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186506.004237:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784186506.004493:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784186506.004507:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186506.004516:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186506.004577:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784186506.004603:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186506.004627:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784186506.004869:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937954304 00000100:00100000:0.0:1784186506.004873:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937954304 00000100:00100000:0.0:1784186506.004988:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1784186506.004998:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937954304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186506.005282:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937954304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186506.005290:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784186506.005561:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784186506.005596:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784186506.005643:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186506.005673:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784186506.006091:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937954432 00000100:00100000:3.0:1784186506.006098:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937954432 00000100:00100000:3.0:1784186506.006138:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1784186506.006304:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937954432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186506.006506:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937954432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186506.006571:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186506.006827:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000040:00080000:2.0:1784186506.007220:0:11060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784186506.007289:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784186506.007314:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784186506.007324:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186506.007335:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186506.007344:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784186506.007346:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc5f8f800 from 7 10000000:01000000:0.0:1784186506.007349:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784186506.007378:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186506.007385:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186506.007394:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186506.007415:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784186506.007720:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186506.007758:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffeea19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186506.008418:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937954560 00000100:00100000:2.0:1784186506.008426:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937954560 00000100:00100000:2.0:1784186506.008496:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1784186506.008505:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937954560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784186506.008522:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186506.008546:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc766c800/0x55bc3e8c99d191f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d191f1 expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186506.008570:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766c800/0x55bc3e8c99d191f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d191f1 expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186506.008580:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc766c800/0x55bc3e8c99d191f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d191f1 expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186506.008590:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c800, rc 0) 00000100:00100000:2.0:1784186506.008638:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937954560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186506.008644:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1784186506.008764:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186506.008780:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186506.008790:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186506.008843:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186506.008877:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186506.009084:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffeea19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186506.009100:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937954688 00000100:00100000:0.0:1784186506.009104:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937954688 00000100:00100000:0.0:1784186506.009174:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1784186506.009181:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937954688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186506.009435:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937954688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186506.009467:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1784186506.010045:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186506.010087:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186506.010132:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186506.010255:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffeea19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186506.010302:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937954816 00000100:00100000:3.0:1784186506.010308:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937954816 00000100:00100000:3.0:1784186506.010374:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1784186506.010383:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937954816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186506.010587:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937954816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186506.010595:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1784186506.010945:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937954816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784186506.014787:0:11061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784186506.022468:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784186506.022505:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784186506.022529:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186506.022553:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186506.304715:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186506.429618:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186506.429645:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937954944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186506.429720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186506.429799:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937954944 00000100:00100000:1.0:1784186506.429807:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937954944 00000100:00100000:1.0:1784186506.429865:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784186506.429874:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937954944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784186506.429915:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186506.429963:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937954944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186506.429971:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1784186506.429998:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784186506.430029:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ec7294e00 x1870854937954944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186506.430047:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937954944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784186507.327284:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186507.454330:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937955200:0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.454427:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186507.454533:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937955712:0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.454571:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186507.454613:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784186507.454620:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937955072:0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.454648:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186507.454669:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937955584:0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.454688:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186507.454712:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937955328:0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.454732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186507.454748:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784186507.454752:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937955456:0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.454772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186507.454803:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937955200 00000100:00100000:2.0:1784186507.454811:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937955200 00000100:00100000:2.0:1784186507.454850:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937955584 00000100:00100000:2.0:1784186507.454852:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937955584 00000100:00100000:2.0:1784186507.454887:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937955328 00000100:00100000:2.0:1784186507.454890:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937955328 00000100:00100000:2.0:1784186507.454907:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784186507.454915:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937955200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.454966:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937955200:12345-0@lo:400:kworker.0 Request processed in 51us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186507.454974:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784186507.454992:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784186507.454998:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937955584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.455023:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937955584:12345-0@lo:400:kworker.0 Request processed in 26us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186507.455028:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784186507.455047:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784186507.455053:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937955328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.455084:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937955328:12345-0@lo:400:kworker.0 Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186507.455090:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784186507.455107:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937955712 00000100:00100000:2.0:1784186507.455111:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937955712 00000100:00100000:2.0:1784186507.455135:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937955456 00000100:00100000:2.0:1784186507.455137:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937955456 00000100:00100000:2.0:1784186507.455150:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784186507.455155:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937955712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.455189:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937955712:12345-0@lo:400:kworker.0 Request processed in 33us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186507.455194:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784186507.455203:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784186507.455208:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937955456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.455233:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937955456:12345-0@lo:400:kworker.0 Request processed in 25us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186507.455238:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784186507.455257:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937955072 00000100:00100000:2.0:1784186507.455260:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937955072 00000100:00100000:2.0:1784186507.455283:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1784186507.455288:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937955072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.455314:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937955072:12345-0@lo:400:kworker.0 Request processed in 25us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186507.455320:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00080000:2.0:1784186507.455378:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc2f73800 x1870854937955456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186507.455398:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937955456:0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.455411:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937955328:0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.455437:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937955072:0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.455468:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937955584:0@lo:400:kworker.0 00000100:00100000:2.0:1784186507.455476:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937955200:0@lo:400:kworker.0 00010000:00080000:2.0:1784186507.455485:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffd542a00 x1870854937955712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186507.455494:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937955712:0@lo:400:kworker.0 00000100:00080000:1.0:1784186507.455805:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186507.455810:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186507.972610:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937955840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784186507.972694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186507.975981:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937955840 00000100:00100000:0.0:1784186507.976000:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937955840 00000100:00100000:0.0:1784186507.976072:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784186507.976083:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937955840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186507.976125:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186507.976223:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937955840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (3529us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186507.976231:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1784186507.976282:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc2e6ad80 x1870854937955840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186507.976326:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937955840:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1784186508.155335:0:11200:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784186508.350416:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186509.374983:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186509.659857:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186509.659955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186509.660002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186509.660038:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915899008 00000100:00100000:2.0:1784186509.660048:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915899008 00000100:00100000:2.0:1784186509.660119:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915899136 00000100:00100000:2.0:1784186509.660123:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915899136 00000100:00100000:2.0:1784186509.660149:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00100000:2.0:1784186509.660159:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2355:x1870854915899008:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186509.661490:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2355:x1870854915899008:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 1315us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186509.661504:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00100000:2.0:1784186509.661532:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 93 00000100:00100000:2.0:1784186509.661543:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915899136:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186509.661607:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915899136:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 67us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186509.661613:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 93 00000100:00080000:2.0:1784186509.661638:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186509.666179:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915898880 00000100:00100000:0.0:1784186509.666194:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915898880 00000100:00100000:1.0:1784186509.672639:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 244 00000100:00100000:1.0:1784186509.672655:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915898880:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186509.672870:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915898880:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 218us (13648us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186509.672878:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 244 00010000:00010000:1.0:1784186510.398795:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784186511.418675:0:11299:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:21:50 (1784186510) === 00010000:00010000:1.0:1784186511.421651:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186511.549990:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937955968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186511.550068:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186511.550173:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937955968 00000100:00100000:3.0:1784186511.550182:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937955968 00000100:00100000:3.0:1784186511.550248:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784186511.550258:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937955968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784186511.550294:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186511.550380:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937955968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186511.550388:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1784186511.550588:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc2e6b100 x1870854937955968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186527 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186511.550609:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937955968:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784186511.550676:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784186511.623275:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186511.623366:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186511.623500:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915899264 00000100:00100000:0.0:1784186511.623510:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915899264 00000100:00100000:0.0:1784186511.623626:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:0.0:1784186511.623638:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915899264:12345-192.168.201.31@tcp:41:mkdir.0 00000004:00000024:0.0:1784186511.623688:0:5784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784186511.623780:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915899264:12345-192.168.201.31@tcp:41:mkdir.0 Request processed in 144us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186511.623788:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:1.0:1784186511.623859:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915899392 00000100:00100000:1.0:1784186511.623864:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915899392 00000100:00100000:1.0:1784186511.623889:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:1.0:1784186511.623895:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:9659:x1870854915899392:12345-192.168.201.31@tcp:700:mkdir.0 00000100:00100000:1.0:1784186511.623928:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:9659:x1870854915899392:12345-192.168.201.31@tcp:700:mkdir.0 Request processed in 33us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186511.623934:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00080000:2.0:1784186511.624065:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186511.626863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186511.626959:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915899648 00000100:00100000:2.0:1784186511.626968:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915899648 00000100:00100000:2.0:1784186511.627135:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:2.0:1784186511.627145:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:9659:x1870854915899648:12345-192.168.201.31@tcp:36:mkdir.0 00010000:00010000:2.0:1784186511.627199:0:7478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186511.627273:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed200/0x55bc3e8c99d190e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763f3 expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.627294:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd1d53700) 00010000:00010000:2.0:1784186511.627305:0:7478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186511.627822:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d191ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.627836:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d191ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.627846:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d191ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.627877:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19206 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.627893:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.627899:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186511.630397:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784186511.630415:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d191ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.630639:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d191ff lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.630649:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d191ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.630656:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186511.630661:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d191ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.630669:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d191ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.630684:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:2.0:1784186511.630687:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186511.630691:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d191ff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.630697:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d191ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784186511.630717:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000089994b6e reply state 00000000072b0128 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186511.630735:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186511.630893:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:9659:x1870854915899648:12345-192.168.201.31@tcp:36:mkdir.0 Request processed in 3744us (4037us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784186511.630903:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00010000:00010000:3.0:1784186511.635722:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19206 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.635742:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19206 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.635750:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19206 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.635757:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766cc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186511.635761:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19206 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.635770:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19206 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.635790:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186511.635805:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186511.635810:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19206 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.635817:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19206 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186511.656314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186511.656588:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915899776 00000100:00100000:3.0:1784186511.656598:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915899776 00000100:00100000:3.0:1784186511.656705:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:3.0:1784186511.656715:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:9660:x1870854915899776:12345-192.168.201.31@tcp:101:chmod.0 00010000:00010000:3.0:1784186511.656738:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186511.656762:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1920d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576478 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.656832:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19214 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.656848:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.656859:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186511.656916:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784186511.656920:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186511.657124:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.657152:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1920d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576478 expref: 8 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.657192:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19214 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576478 expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.657201:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718a00) 00010000:00010000:3.0:1784186511.657204:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186511.657207:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17000, rc 0) 00000100:00100000:3.0:1784186511.657272:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:9660:x1870854915899776:12345-192.168.201.31@tcp:101:chmod.0 Request processed in 558us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186511.657278:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:2.0:1784186511.662956:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186511.663113:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915900032 00000100:00100000:1.0:1784186511.663125:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915900032 00000100:00100000:1.0:1784186511.663188:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:1.0:1784186511.663199:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:9660:x1870854915900032:12345-192.168.201.31@tcp:36:chmod.0 00010000:00010000:1.0:1784186511.663262:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186511.663288:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19214 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576478 expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.663307:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718a00) 00010000:00010000:1.0:1784186511.663327:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784186511.663364:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1921b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.663378:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1921b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.663387:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1921b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784186511.663966:0:5782:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be637500 reply state 000000003a32e3f1 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1921b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186511.663976:0:5782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784186511.664144:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1784186511.664300:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:9660:x1870854915900032:12345-192.168.201.31@tcp:36:chmod.0 Request processed in 1101us (1353us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784186511.664307:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00010000:00010000:0.0:1784186511.669356:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1921b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.669374:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1921b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.669383:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1921b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.669390:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186511.669395:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1921b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.669402:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1921b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.669477:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd1d53800) 00010000:00010000:0.0:1784186511.669481:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784186511.669486:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1921b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.669494:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1921b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186511.682230:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186511.682804:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915900160 00000100:00100000:0.0:1784186511.682814:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915900160 00000100:00100000:0.0:1784186511.682870:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:0.0:1784186511.682879:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:9661:x1870854915900160:12345-192.168.201.31@tcp:101:chown.0 00010000:00010000:0.0:1784186511.682899:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186511.682918:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128200/0x55bc3e8c99d19222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57647f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.682977:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129400/0x55bc3e8c99d19229 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.683002:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129400/0x55bc3e8c99d19229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.683013:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129400/0x55bc3e8c99d19229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186511.683073:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1784186511.683077:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186511.683109:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129400/0x55bc3e8c99d19229 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.683143:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128200/0x55bc3e8c99d19222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57647f expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.683156:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129400/0x55bc3e8c99d19229 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57647f expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.683162:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011a300) 00010000:00010000:0.0:1784186511.683164:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784186511.683167:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129400, rc 0) 00000100:00100000:0.0:1784186511.683221:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:9661:x1870854915900160:12345-192.168.201.31@tcp:101:chown.0 Request processed in 344us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186511.683226:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:1.0:1784186511.685936:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186511.686094:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915900288 00000100:00100000:2.0:1784186511.686102:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915900288 00000100:00100000:2.0:1784186511.686170:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:2.0:1784186511.686177:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+8:9661:x1870854915900288:12345-192.168.201.31@tcp:101:chown.0 00010000:00010000:2.0:1784186511.686193:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186511.686208:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19230 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576486 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686265:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19237 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686279:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19237 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686290:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19237 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686300:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d1923e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686305:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d1923e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686317:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d1923e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686617:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686623:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686628:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186511.686665:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784186511.686669:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186511.686696:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686706:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19237 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686710:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19237 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686715:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19237 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686718:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186511.686721:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19237 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686726:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19237 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686745:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011a300) 00010000:00010000:2.0:1784186511.686748:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186511.686753:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19237 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686759:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19237 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686774:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d1923e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686779:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d1923e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686785:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d1923e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686790:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186511.686793:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d1923e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686799:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d1923e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686806:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b9fc5142800) 00010000:00010000:2.0:1784186511.686809:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186511.686811:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d1923e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686817:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d1923e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686855:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19230 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576486 expref: 10 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686864:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576486 expref: 9 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.686869:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fc5142a00) 00010000:00010000:2.0:1784186511.686870:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784186511.686872:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766cc00, rc 0) 00000100:00100000:2.0:1784186511.686968:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+9:9661:x1870854915900288:12345-192.168.201.31@tcp:101:chown.0 Request processed in 790us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186511.686976:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:3.0:1784186511.689158:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186511.689424:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915900544 00000100:00100000:1.0:1784186511.689434:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915900544 00000100:00100000:1.0:1784186511.689548:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:1.0:1784186511.689559:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+9:9661:x1870854915900544:12345-192.168.201.31@tcp:36:chown.0 00010000:00010000:1.0:1784186511.689613:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186511.689638:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19245 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576486 expref: 9 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.689659:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fc5142a00) 00010000:00010000:1.0:1784186511.689669:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784186511.689695:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d1924c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.689704:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d1924c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.689711:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d1924c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784186511.720592:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005260b164 reply state 0000000022c4a53b transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d1924c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186511.720610:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784186511.720774:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1784186511.720885:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+10:9661:x1870854915900544:12345-192.168.201.31@tcp:36:chown.0 Request processed in 31324us (31730us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1784186511.720894:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000001:00080000:3.0:1784186511.721496:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1784186511.721675:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d1924c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.721687:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d1924c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.721694:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d1924c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.721700:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ece00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186511.721704:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d1924c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.721712:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d1924c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.721730:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fd1d53000) 00010000:00010000:1.0:1784186511.721733:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784186511.721738:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d1924c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.721744:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d1924c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186511.739077:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186511.739182:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915900672 00000100:00100000:1.0:1784186511.739192:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915900672 00000100:00100000:1.0:1784186511.739250:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:1.0:1784186511.739260:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:9662:x1870854915900672:12345-192.168.201.31@tcp:101:touch.500 00010000:00010000:1.0:1784186511.739282:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186511.739302:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19253 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57648d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784186511.747868:0:5782:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 8519us 00010000:00010000:1.0:1784186511.755670:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d1925a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.755693:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d1925a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.755705:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d1925a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.755723:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19261 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.755731:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19261 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.755737:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19261 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756225:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19268 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756247:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756255:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186511.756336:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784186511.756340:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784186511.756807:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756824:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d1925a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756832:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d1925a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756839:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d1925a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756846:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186511.756850:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d1925a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756858:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d1925a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756873:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011a300) 00010000:00010000:1.0:1784186511.756876:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186511.756881:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d1925a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756898:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d1925a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756911:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19261 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756916:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19261 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756922:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19261 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756926:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27eca00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186511.756929:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19261 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756934:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19261 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756942:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b9fd1d53000) 00010000:00010000:1.0:1784186511.756944:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186511.756947:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19261 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.756953:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19261 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.757055:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19253 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57648d expref: 8 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.757072:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57648d expref: 7 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.757085:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fd1d53a00) 00010000:00010000:1.0:1784186511.757088:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784186511.757090:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27edc00, rc 0) 00000100:00100000:1.0:1784186511.757199:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:9662:x1870854915900672:12345-192.168.201.31@tcp:101:touch.500 Request processed in 17938us (18131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186511.757208:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:1.0:1784186511.760414:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186511.760722:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915900928 00000100:00100000:3.0:1784186511.760732:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915900928 00000100:00100000:3.0:1784186511.760820:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:3.0:1784186511.760831:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:9662:x1870854915900928:12345-192.168.201.31@tcp:101:touch.500 00010000:00010000:3.0:1784186511.760854:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186511.760875:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1926f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576494 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.761209:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d19276 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.761224:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d19276 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.761236:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d19276 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.761306:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1927d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.761314:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1927d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.761320:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1927d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784186511.762810:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1784186511.763252:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19284 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.763267:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.763278:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.763315:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d19276 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.763322:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d19276 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.763329:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d19276 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.763334:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186511.763338:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d19276 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.763356:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d19276 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.763368:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fd1d53a00) 00010000:00010000:3.0:1784186511.763371:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186511.763375:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d19276 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.763380:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d19276 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784186511.763392:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f898d6c6 reply state 00000000eee42988 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1927d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186511.763401:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784186511.763665:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1926f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576494 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.763680:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19284 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576494 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.763688:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b9fc7718700) 00010000:00010000:3.0:1784186511.763691:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186511.763693:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17e00, rc 0) 00000100:00100000:2.0:1784186511.763872:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+10:9662:x1870854915900928:12345-192.168.201.31@tcp:101:touch.500 Request processed in 3041us (3465us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784186511.763882:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:2.0:1784186511.769085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186511.769278:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915901184 00000100:00100000:3.0:1784186511.769289:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915901184 00000100:00100000:3.0:1784186511.769410:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:3.0:1784186511.769431:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+10:9662:x1870854915901184:12345-192.168.201.31@tcp:36:touch.500 00010000:00010000:3.0:1784186511.769534:0:7478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186511.769570:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19284 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576494 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.769588:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b9fc7718700) 00010000:00010000:3.0:1784186511.769611:0:7478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186511.769655:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d19292 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.769668:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d19292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.769677:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d19292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784186511.769808:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dff8bcf0 reply state 00000000b5b26e86 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d19292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186511.769817:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784186511.769908:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+11:9662:x1870854915901184:12345-192.168.201.31@tcp:36:touch.500 Request processed in 488us (832us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784186511.769916:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00010000:00010000:0.0:1784186511.769992:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1927d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.770001:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1927d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.770008:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1927d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.770014:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186511.770017:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1927d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.770024:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1927d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.770044:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2a24774b (ffff9b9fc7718800) 00010000:00010000:0.0:1784186511.770048:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186511.770051:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1927d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186511.770058:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1927d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186511.776492:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00010000:00010000:1.0:1784186511.776679:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d19292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.776691:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d19292 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.776698:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d19292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.776705:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186511.776709:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d19292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.776717:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d19292 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.776735:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b9fc7718900) 00010000:00010000:1.0:1784186511.776738:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186511.776742:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d19292 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.776748:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d19292 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186511.776848:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915901312 00000100:00100000:2.0:1784186511.776858:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915901312 00000100:00100000:2.0:1784186511.776911:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:2.0:1784186511.776920:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+9:9662:x1870854915901312:12345-192.168.201.31@tcp:101:touch.500 00010000:00010000:2.0:1784186511.776943:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186511.776961:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19299 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57649b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.777029:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57649b expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.777054:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57649b expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.777073:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:2.0:1784186511.777076:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784186511.777078:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d800, rc 0) 00000100:00100000:2.0:1784186511.777140:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+10:9662:x1870854915901312:12345-192.168.201.31@tcp:101:touch.500 Request processed in 221us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186511.777148:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:1.0:1784186511.780952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186511.781108:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915901440 00000100:00100000:2.0:1784186511.781118:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915901440 00000100:00100000:2.0:1784186511.781202:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:2.0:1784186511.781210:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1870854915901440:12345-192.168.201.31@tcp:8:touch.500 00010000:00080000:2.0:1784186511.781247:0:6583:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:2.0:1784186511.781287:0:6583:0:(genops.c:1406:class_connect()) connect: client efb6eb2c-5579-43c6-be4f-310412860e5b, cookie 0x55bc3e8c99d192a0 00002000:00100000:2.0:1784186511.781299:0:6583:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli efb6eb2c-5579-43c6-be4f-310412860e5b/ffff9b9ffeda4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784186511.781323:0:6583:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784186511.781799:0:6583:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784186511.781832:0:6583:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeda7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784186511.781938:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2353:x1870854915901440:12345-192.168.201.31@tcp:8:touch.500 Request processed in 726us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186511.781947:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1784186511.784617:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186511.784739:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915901568 00000100:00100000:2.0:1784186511.784748:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915901568 00000100:00100000:2.0:1784186511.784874:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:2.0:1784186511.784885:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:0:x1870854915901568:12345-192.168.201.31@tcp:2:touch.500 00000100:00080000:1.0:1784186511.785305:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1784186511.812012:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1784186511.812032:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00000100:00100000:0.0:1784186511.812196:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:0:x1870854915901568:12345-192.168.201.31@tcp:2:touch.500 Request processed in 27304us (27579us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784186511.812208:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:1.0:1784186511.816724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186511.816861:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915901824 00000100:00100000:2.0:1784186511.816870:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915901824 00000100:00100000:2.0:1784186511.816952:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:2.0:1784186511.816962:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+10:9662:x1870854915901824:12345-192.168.201.31@tcp:35:touch.500 00000100:00100000:2.0:1784186511.817302:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+11:9662:x1870854915901824:12345-192.168.201.31@tcp:35:touch.500 Request processed in 340us (878us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784186511.817309:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:1.0:1784186511.829179:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186511.829363:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915901952 00000100:00100000:2.0:1784186511.829376:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915901952 00000100:00100000:3.0:1784186511.829742:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:3.0:1784186511.829904:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+11:9663:x1870854915901952:12345-192.168.201.31@tcp:101:rm.0 00010000:00010000:3.0:1784186511.829929:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186511.829951:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d192a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764a2 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.830025:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d192ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.830056:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d192ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.830068:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d192ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186511.830129:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784186511.830133:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186511.830186:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d192ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.830212:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d192a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764a2 expref: 13 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.830241:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d192ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764a2 expref: 12 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.830250:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fd1d53a00) 00010000:00010000:3.0:1784186511.830253:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186511.830256:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf16e00, rc 0) 00000100:00100000:3.0:1784186511.830314:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+12:9663:x1870854915901952:12345-192.168.201.31@tcp:101:rm.0 Request processed in 563us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186511.830321:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:1.0:1784186511.836332:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186511.836516:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915902208 00000100:00100000:2.0:1784186511.836526:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915902208 00000100:00100000:2.0:1784186511.836868:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:2.0:1784186511.836879:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+12:9663:x1870854915902208:12345-192.168.201.31@tcp:101:rm.0 00010000:00010000:2.0:1784186511.836900:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186511.836922:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d192b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764a9 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186511.837042:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1784186511.837205:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d192b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764a9 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.837219:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011a300) 00010000:00010000:2.0:1784186511.837233:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784186511.837239:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d192b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764a9 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.837265:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d600, rc 0) 00000100:00100000:2.0:1784186511.837328:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+13:9663:x1870854915902208:12345-192.168.201.31@tcp:101:rm.0 Request processed in 451us (1006us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1784186511.837335:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:1.0:1784186511.841563:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186511.841794:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915902336 00000100:00100000:3.0:1784186511.841803:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915902336 00000100:00100000:3.0:1784186511.841855:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:3.0:1784186511.841867:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+13:9663:x1870854915902336:12345-192.168.201.31@tcp:37:rm.0 00000100:00100000:3.0:1784186511.849345:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+13:9663:x1870854915902336:12345-192.168.201.31@tcp:37:rm.0 Request processed in 7467us (7788us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186511.849380:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:1.0:1784186511.853810:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186511.853951:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915902592 00000100:00100000:2.0:1784186511.853962:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915902592 00000100:00100000:2.0:1784186511.854023:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:2.0:1784186511.854034:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89bac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+13:9663:x1870854915902592:12345-192.168.201.31@tcp:35:rm.0 00000100:00100000:2.0:1784186511.854321:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89bac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+14:9663:x1870854915902592:12345-192.168.201.31@tcp:35:rm.0 Request processed in 286us (520us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784186511.854329:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:1.0:1784186511.857976:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186511.858113:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915902848 00000100:00100000:3.0:1784186511.858124:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915902848 00000100:00100000:3.0:1784186511.858251:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:3.0:1784186511.858262:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+14:9663:x1870854915902848:12345-192.168.201.31@tcp:101:rm.0 00010000:00010000:3.0:1784186511.858292:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186511.858318:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d192c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764b0 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.858531:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d192ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.858546:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d192ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.858558:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d192ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186511.858570:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1784186511.858926:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d192c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764b0 expref: 17 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.858947:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d192ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764b0 expref: 16 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.858956:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fd1d53a00) 00010000:00010000:3.0:1784186511.858959:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784186511.858963:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf16000, rc 0) 00000100:00100000:3.0:1784186511.859026:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+16:9663:x1870854915902848:12345-192.168.201.31@tcp:101:rm.0 Request processed in 765us (1060us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1784186511.859034:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:1.0:1784186511.862336:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186511.862414:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915902976 00000100:00100000:3.0:1784186511.862423:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915902976 00000100:00100000:3.0:1784186511.862509:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:3.0:1784186511.862527:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+16:9663:x1870854915902976:12345-192.168.201.31@tcp:41:rm.0 00000004:00000024:3.0:1784186511.862589:0:5783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1784186511.862666:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+16:9663:x1870854915902976:12345-192.168.201.31@tcp:41:rm.0 Request processed in 149us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186511.862674:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:1.0:1784186511.865376:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186511.865481:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915903104 00000100:00100000:2.0:1784186511.865490:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915903104 00000100:00100000:2.0:1784186511.865552:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:2.0:1784186511.865561:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+16:9663:x1870854915903104:12345-192.168.201.31@tcp:101:rm.0 00010000:00010000:2.0:1784186511.865582:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186511.865603:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d192d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764b7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.865885:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d192df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.865900:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d192df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.865911:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d192df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.865942:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d192e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.865951:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d192e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.865958:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d192e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866076:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d192ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866085:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d192ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866093:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d192ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186511.866123:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784186511.866128:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186511.866146:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d192ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866158:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d192ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866166:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d192df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866173:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d192df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866190:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d192df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866195:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766ce00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186511.866199:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d192df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866207:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d192df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866219:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fd1d53a00) 00010000:00010000:2.0:1784186511.866222:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186511.866227:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d192df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866234:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d192df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866248:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d192e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866254:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d192e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866260:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d192e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866264:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186511.866267:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d192e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866282:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d192e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866290:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2a24774b (ffff9b9fc5142e00) 00010000:00010000:2.0:1784186511.866293:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186511.866296:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d192e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866302:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d192e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866334:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d192d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764b7 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866348:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d192ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764b7 expref: 17 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186511.866355:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:2.0:1784186511.866358:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186511.866360:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d200, rc 0) 00000100:00100000:2.0:1784186511.866413:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+17:9663:x1870854915903104:12345-192.168.201.31@tcp:101:rm.0 Request processed in 853us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186511.866420:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:1.0:1784186511.870714:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186511.870886:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915903360 00000100:00100000:3.0:1784186511.870898:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915903360 00000100:00100000:3.0:1784186511.871138:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:3.0:1784186511.871151:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+17:9663:x1870854915903360:12345-192.168.201.31@tcp:36:rm.0 00010000:00010000:3.0:1784186511.871219:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784186511.871254:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d192ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764b7 expref: 17 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.871282:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19299 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57649b expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.871294:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186511.871311:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d192ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764a2 expref: 15 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.871321:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fd1d53a00) 00010000:00010000:3.0:1784186511.871338:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186511.871417:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d192f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.871603:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d192f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.871614:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d192f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.871631:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d192fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.871705:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d192fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.871714:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d192fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.871930:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19302 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.871939:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.871946:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784186511.873393:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1784186511.873406:0:5783:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 290594963938ns, next at 291594961009ns, rc = 0 00010000:00010000:3.0:1784186511.873502:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19309 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873584:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873593:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873601:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19309 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873608:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19309 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873614:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873678:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784186511.873699:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873706:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19302 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873712:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19302 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873718:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186511.873721:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19302 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873728:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19302 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873805:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b9fc7718700) 00010000:00010000:3.0:1784186511.873809:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784186511.873814:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19302 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873821:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d19302 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873838:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d192f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873844:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d192f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873850:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d192f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873856:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186511.873858:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d192f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873864:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d192f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873871:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fd1d53a00) 00010000:00010000:3.0:1784186511.873873:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186511.873875:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d192f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.873881:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d192f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784186511.873899:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000747f5d7e reply state 000000007b98fa0e transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d192fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186511.873907:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784186511.873992:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+16:9663:x1870854915903360:12345-192.168.201.31@tcp:36:rm.0 Request processed in 2841us (3285us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784186511.874000:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00010000:00010000:3.0:1784186511.877542:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d192fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.877561:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d192fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.877569:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d192fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.877575:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186511.877580:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d192fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.877587:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d192fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.877603:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2a24774b (ffff9b9fc7718900) 00010000:00010000:3.0:1784186511.877606:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186511.877610:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d192fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.877616:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d192fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2a24774b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186511.878900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186511.879168:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915903616 00000100:00100000:2.0:1784186511.879179:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915903616 00000100:00100000:2.0:1784186511.879231:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:2.0:1784186511.879242:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+15:9663:x1870854915903616:12345-192.168.201.31@tcp:35:rm.0 00000100:00100000:2.0:1784186511.879565:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+16:9663:x1870854915903616:12345-192.168.201.31@tcp:35:rm.0 Request processed in 323us (674us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784186511.879573:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:2.0:1784186511.882343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186511.882428:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915903872 00000100:00100000:3.0:1784186511.882471:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915903872 00000100:00100000:3.0:1784186511.882539:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:3.0:1784186511.882549:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+16:9663:x1870854915903872:12345-192.168.201.31@tcp:36:rm.0 00010000:00010000:3.0:1784186511.882610:0:7478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784186511.882637:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d192ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764b0 expref: 16 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.882674:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19268 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57648d expref: 15 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.882686:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fd1d53a00) 00010000:00010000:3.0:1784186511.883053:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129400/0x55bc3e8c99d19229 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57647f expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.883065:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011a300) 00010000:00010000:3.0:1784186511.883072:0:7478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186511.883096:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17800/0x55bc3e8c99d19310 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.883109:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17800/0x55bc3e8c99d19310 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.883118:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17800/0x55bc3e8c99d19310 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.883131:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19317 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.883151:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19317 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.883158:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19317 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.883496:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d1931e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.883505:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d1931e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.883512:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d1931e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.884336:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186511.884356:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19309 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.884365:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17e00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186511.884369:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19309 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.884378:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.884392:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9b9fc7718700) 00010000:00010000:1.0:1784186511.884394:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784186511.884399:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19309 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.884415:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d19309 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.884816:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186511.884819:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186511.884821:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:3.0:1784186511.886156:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1784186511.886180:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d1931e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886188:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d1931e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886194:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d1931e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886199:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186511.886204:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d1931e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886209:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d1931e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886234:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:3.0:1784186511.886237:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784186511.886241:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d1931e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886248:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d1931e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886281:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17800/0x55bc3e8c99d19310 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886288:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17800/0x55bc3e8c99d19310 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886294:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17800/0x55bc3e8c99d19310 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886300:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186511.886303:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17800/0x55bc3e8c99d19310 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886309:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17800/0x55bc3e8c99d19310 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886316:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718800) 00010000:00010000:3.0:1784186511.886319:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186511.886321:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17800/0x55bc3e8c99d19310 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186511.886327:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17800/0x55bc3e8c99d19310 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784186511.886404:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce631731 reply state 000000000ac7705f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19317 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186511.886416:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186511.887010:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+15:9663:x1870854915903872:12345-192.168.201.31@tcp:36:rm.0 Request processed in 4456us (4671us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784186511.887019:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00010000:00010000:1.0:1784186511.889998:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19317 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.890017:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19317 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.890024:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19317 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.890030:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186511.890036:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19317 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.890043:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19317 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.890060:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9b9fc7718a00) 00010000:00010000:1.0:1784186511.890063:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186511.890068:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19317 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186511.890074:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19317 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186512.445733:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186512.573639:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937956096:0@lo:400:kworker.0 00000100:00100000:2.0:1784186512.573709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186512.573816:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937956096 00000100:00100000:0.0:1784186512.573823:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937956096 00000100:00100000:0.0:1784186512.573876:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1784186512.573885:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937956096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186512.574176:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937956096:12345-0@lo:400:kworker.0 Request processed in 291us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186512.574183:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1784186512.574280:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937956224:0@lo:400:kworker.0 00000100:00100000:1.0:1784186512.574324:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186512.574344:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937956736:0@lo:400:kworker.0 00000100:00100000:1.0:1784186512.574366:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186512.574387:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784186512.574392:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937956608:0@lo:400:kworker.0 00000100:00100000:1.0:1784186512.574437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186512.574486:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937956224 00000100:00100000:1.0:1784186512.574490:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937956224 00000100:00100000:1.0:1784186512.574519:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937956608 00000100:00100000:1.0:1784186512.574523:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937956608 00000100:00100000:1.0:1784186512.574551:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784186512.574557:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937956224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186512.574593:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937956224:12345-0@lo:400:kworker.0 Request processed in 35us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186512.574599:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1784186512.574617:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784186512.574623:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937956608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186512.574647:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937956608:12345-0@lo:400:kworker.0 Request processed in 25us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186512.574652:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1784186512.574670:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937956736 00000100:00100000:1.0:1784186512.574674:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937956736 00000100:00100000:1.0:1784186512.574700:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784186512.574705:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937956736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186512.574733:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937956736:12345-0@lo:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186512.574739:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1784186512.574764:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186512.574768:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186512.574798:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937956608:0@lo:400:kworker.0 00000100:00100000:1.0:1784186512.574808:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937956224:0@lo:400:kworker.0 00010000:00080000:1.0:1784186512.574819:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fefd1d180 x1870854937956736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186512.574829:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937956736:0@lo:400:kworker.0 00000100:00100000:3.0:1784186512.574917:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937956480:0@lo:400:kworker.0 00000100:00100000:3.0:1784186512.574949:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186512.574968:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784186512.574973:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937956352:0@lo:400:kworker.0 00000100:00100000:3.0:1784186512.574992:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186512.575012:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937956480 00000100:00100000:3.0:1784186512.575015:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937956480 00000100:00100000:3.0:1784186512.575036:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784186512.575041:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937956480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186512.575078:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937956480:12345-0@lo:400:kworker.0 Request processed in 36us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186512.575084:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784186512.575099:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937956096:0@lo:400:kworker.0 00010000:00080000:3.0:1784186512.575117:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fefd1f480 x1870854937956480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186512.575117:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937956352 00000100:00100000:2.0:1784186512.575120:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937956352 00000100:00100000:3.0:1784186512.575126:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937956480:0@lo:400:kworker.0 00000100:00100000:2.0:1784186512.575146:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784186512.575151:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937956352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186512.575192:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937956352:12345-0@lo:400:kworker.0 Request processed in 41us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186512.575199:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784186512.575227:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937956352:0@lo:400:kworker.0 00000100:00080000:1.0:1784186512.575325:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1784186513.085658:0:7864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 291807214334ns, next at 292807211733ns, rc = 0 00000100:00100000:0.0:1784186513.085684:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186513.085769:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937956864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186513.085838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186513.086018:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937956864 00000100:00100000:2.0:1784186513.086026:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937956864 00000100:00100000:2.0:1784186513.086086:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784186513.086095:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937956864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784186513.086238:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186513.086297:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937956864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186513.086305:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1784186513.086386:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c5ad80 x1870854937956864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186513.086405:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937956864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784186513.475206:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186514.493641:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186514.767885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186514.767930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186514.768014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186514.768049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186514.768079:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915904128 00000100:00100000:2.0:1784186514.768087:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915904128 00000100:00100000:2.0:1784186514.768139:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915904384 00000100:00100000:2.0:1784186514.768142:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915904384 00000100:00100000:2.0:1784186514.768160:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 97 00000100:00100000:2.0:1784186514.768168:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+14:2354:x1870854915904128:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186514.768235:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+14:2354:x1870854915904128:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 67us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186514.768242:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 97 00000100:00100000:0.0:1784186514.768436:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 98 00000100:00100000:0.0:1784186514.768485:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915904384:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186514.768512:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915904384:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 30us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186514.768518:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 98 00000100:00080000:0.0:1784186514.768538:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186514.768760:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915904000 00000100:00100000:3.0:1784186514.768765:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915904000 00000100:00100000:3.0:1784186514.768802:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 246 00000100:00100000:3.0:1784186514.768808:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915904000:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186514.768860:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915904000:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 51us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186514.768867:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 246 00000100:00100000:1.0:1784186514.771437:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915904256 00000100:00100000:1.0:1784186514.771462:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915904256 00000100:00100000:1.0:1784186514.771605:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:1.0:1784186514.771616:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2354:x1870854915904256:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186514.771699:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2354:x1870854915904256:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 84us (3767us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186514.771706:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00080000:0.0:1784186514.778746:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784186515.519865:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784186515.888307:0:11451:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1784186516.544847:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186516.683646:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186516.683682:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937956992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186516.683753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186516.683814:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937956992 00000100:00100000:0.0:1784186516.683822:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937956992 00000100:00100000:0.0:1784186516.683893:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784186516.683905:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937956992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784186516.683936:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186516.683988:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937956992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186516.683995:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1784186516.685705:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784186516.685915:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5496a00 x1870854937956992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186516.685941:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937956992:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1784186517.012284:0:11499:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff5520f90 20000000:00000080:1.0:1784186517.012315:0:11499:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b9ec49f5800 uarg=0000000000000000 20000000:01000000:1.0:1784186517.012353:0:11499:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1784186517.012369:0:11499:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1784186517.012375:0:11499:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1784186517.014309:0:11500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1784186517.015054:0:11499:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1784186517.023651:0:11499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1784186517.023722:0:11499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1784186517.023782:0:11499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1784186517.023800:0:11499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784186517.023821:0:11499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.023842:0:11499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d191c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57646a expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.023850:0:11499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d191ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576471 expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.023868:0:11499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d191dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d191d5 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.023874:0:11499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc9128800/0x55bc3e8c99d191ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d191e3 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.023880:0:11499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc766c800/0x55bc3e8c99d191f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d191f1 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.023887:0:11499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.023928:0:11499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc766c800/0x55bc3e8c99d191f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d191f1 expref: 18 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.023944:0:11499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fc766c800/0x55bc3e8c99d191f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d191f1 expref: 18 pid: 5775 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186517.023958:0:11499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11499:1870854937957120:0@lo:104: 00000100:00100000:0.0:1784186517.024022:0:11499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784186517.024091:0:11499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc9128800/0x55bc3e8c99d191ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d191e3 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.024100:0:11499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fc9128800/0x55bc3e8c99d191ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d191e3 expref: 18 pid: 5774 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186517.024109:0:11499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11499:1870854937957248:0@lo:104: 00000100:00100000:3.0:1784186517.024124:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937957120 00000100:00100000:3.0:1784186517.024132:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937957120 00000100:00100000:0.0:1784186517.024150:0:11499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186517.024171:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937957248 00000100:00100000:3.0:1784186517.024174:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937957248 00010000:00010000:0.0:1784186517.024178:0:11499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d191dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d191d5 expref: 18 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186517.024188:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1784186517.024191:0:11499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d191dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d191d5 expref: 18 pid: 5774 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186517.024195:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+4:11499:x1870854937957120:12345-0@lo:104: 00000100:00100000:0.0:1784186517.024209:0:11499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11499:1870854937957376:0@lo:104: 00010000:00010000:3.0:1784186517.024219:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186517.024233:0:11499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784186517.024250:0:11499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d191ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576471 expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.024260:0:11499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d191ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576471 expref: 12 pid: 5775 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.024264:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784186517.024269:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+4:11499:x1870854937957120:12345-0@lo:104: Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186517.024270:0:11499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11499:1870854937957504:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186517.024276:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784186517.024310:0:5766:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784186517.024319:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937957376 00000100:00100000:3.0:1784186517.024322:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937957376 00010000:00010000:0.0:1784186517.024333:0:11499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d191c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57646a expref: 12 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186517.024336:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784186517.024341:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+4:11499:x1870854937957248:12345-0@lo:104: 00010000:00010000:0.0:1784186517.024343:0:11499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d191c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57646a expref: 12 pid: 5775 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.024348:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186517.024351:0:11499:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11499:1870854937957632:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186517.024393:0:11499:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc6fe9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784186517.024414:0:11499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11499:1870854937957120:0@lo:104: 00010000:00010000:3.0:1784186517.025413:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784186517.025421:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+4:11499:x1870854937957248:12345-0@lo:104: Request processed in 1078us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186517.025429:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1784186517.025455:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784186517.025463:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186517.025471:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128600 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:2.0:1784186517.025475:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186517.025478:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1784186517.025484:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186517.025486:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffee2b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:11499:x1870854937957376:12345-0@lo:104: 10000000:00010000:2.0:1784186517.025491:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.025495:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186517.025497:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784186517.025528:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1784186517.025531:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186517.025532:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffee2b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+3:11499:x1870854937957376:12345-0@lo:104: Request processed in 48us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186517.025538:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1784186517.025543:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784186517.025566:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186517.025572:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128600/0x55bc3e8c99d191f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d191f8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.025582:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784186517.025583:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186517.025586:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.025592:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c400 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:3.0:1784186517.025595:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186517.025599:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937957760:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186517.025602:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784186517.025607:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186517.025612:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784186517.025626:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186517.025631:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784186517.025632:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784186517.025638:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.025653:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c400/0x55bc3e8c99d191e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d191ea expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186517.025658:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1784186517.025662:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186517.025663:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937957888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186517.025664:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186517.025666:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186517.025677:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937957760 00000100:00100000:3.0:1784186517.025681:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937957760 00000100:00100000:2.0:1784186517.025682:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784186517.025701:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc766c800/0x55bc3e8c99d191f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d191f1 expref: 19 pid: 5775 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186517.025705:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937957888 00000100:00100000:2.0:1784186517.025708:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937957888 00000100:00100000:3.0:1784186517.025722:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1784186517.025722:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc9128800/0x55bc3e8c99d191ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d191e3 expref: 20 pid: 5774 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186517.025727:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6759c-e30b-4013-88b9-0b4d132afa93+20:3308:x1870854937957760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186517.025736:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784186517.025739:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1784186517.025741:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc766c800/0x55bc3e8c99d191f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d191f1 expref: 20 pid: 5775 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186517.025744:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+20:3308:x1870854937957888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784186517.025751:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186517.025752:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc766c800/0x55bc3e8c99d191f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d191f1 expref: 20 pid: 5775 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186517.025754:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc9128800/0x55bc3e8c99d191ea lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d191e3 expref: 20 pid: 5774 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.025766:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc766c800/0x55bc3e8c99d191f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d191f1 expref: 20 pid: 5775 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186517.026910:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc9128800/0x55bc3e8c99d191ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d191e3 expref: 19 pid: 5774 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186517.026934:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186517.027080:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937957888:12345-0@lo:103:ldlm_bl.0 Request processed in 1334us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186517.027089:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784186517.027547:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937957888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784186517.028031:0:11499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9128800/0x55bc3e8c99d191ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d191e3 expref: 18 pid: 5774 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186517.028046:0:11499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11499:1870854937957248:0@lo:104: 00000100:00100000:1.0:1784186517.028070:0:11499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11499:1870854937957376:0@lo:104: 00010000:00010000:3.0:1784186517.028398:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186517.028468:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6759c-e30b-4013-88b9-0b4d132afa93+17:3308:x1870854937957760:12345-0@lo:103:ldlm_bl.0 Request processed in 2739us (2835us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186517.028478:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784186517.028653:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937957760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784186517.029998:0:11499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11499:1870854937957504:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186517.030008:0:11499:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11499:1870854937957632:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186517.030034:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186517.030036:0:11499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.030047:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186517.030049:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186517.030071:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186517.030080:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766ca00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:2.0:1784186517.030084:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186517.030093:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186517.030101:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186517.030106:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784186517.030381:0:5770:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186517.030388:0:5770:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784186517.030475:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937958016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784186517.030528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784186517.030603:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186517.030616:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc766ca00/0x55bc3e8c99d191d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d191dc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186517.030630:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937958016 00010000:00010000:2.0:1784186517.030633:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186517.030634:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186517.030636:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937958016 00010000:00010000:2.0:1784186517.030636:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186517.030663:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d191dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d191d5 expref: 17 pid: 5774 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186517.030697:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784186517.030706:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe55b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:3306:x1870854937958016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186517.030719:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186517.030724:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d191dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d191d5 expref: 17 pid: 5774 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.030733:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d191dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d191d5 expref: 17 pid: 5774 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.030752:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27eda00/0x55bc3e8c99d191dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d191d5 expref: 17 pid: 5774 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.030762:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186517.030794:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe55b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:3306:x1870854937958016:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186517.030798:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784186517.031286:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937958016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784186517.031837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186517.032312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186517.032687:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915904512 00000100:00100000:0.0:1784186517.032695:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915904512 00010000:00010000:0.0:1784186517.032728:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d191ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576471 expref: 13 pid: 5775 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186517.032765:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915904640 00000100:00100000:0.0:1784186517.032768:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915904640 00010000:00010000:0.0:1784186517.032783:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d191c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57646a expref: 14 pid: 5775 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186517.032807:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:0.0:1784186517.032817:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+14:2356:x1870854915904512:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186517.032829:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186517.032835:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d191ce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576471 expref: 14 pid: 5775 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.032846:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d191ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576471 expref: 14 pid: 5775 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.032862:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d191ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576471 expref: 14 pid: 5775 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.032877:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186517.032998:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915904512:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 182us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186517.033005:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:0.0:1784186517.033023:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:0.0:1784186517.033030:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:2356:x1870854915904640:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186517.033038:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186517.033042:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d191c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57646a expref: 12 pid: 5775 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033061:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d191c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57646a expref: 12 pid: 5775 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033072:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d191c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57646a expref: 12 pid: 5775 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033084:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033092:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033109:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033130:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033859:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033872:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033879:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186517.033883:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033892:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033930:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.033942:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186517.033977:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:2356:x1870854915904640:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 945us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186517.033984:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00010000:00010000:1.0:1784186517.040488:0:11499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186517.040507:0:11499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186517.040514:0:11499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19325 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784186517.297163:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1784186517.297519:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186517.297554:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937958144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784186517.297626:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186517.297802:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937958144 00000100:00100000:0.0:1784186517.297812:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937958144 00000100:00100000:0.0:1784186517.297868:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784186517.297878:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937958144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784186517.297903:0:6583:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1784186517.297937:0:6583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a58868f, atime: 0x6a58868f, ctime: 0x6a58868f, blocks: 0x1 00010000:00010000:0.0:1784186517.297945:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a629a60/0x55bc3e8c99d1932c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.297963:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=296s v=(0 0) 00010000:00010000:0.0:1784186517.297968:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186517.297975:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a629a60/0x55bc3e8c99d1932c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.297994:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a629a60/0x55bc3e8c99d1932c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.298005:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a629a60/0x55bc3e8c99d1932c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.298024:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a629a60/0x55bc3e8c99d1932c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186517.298039:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784186517.298794:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937958144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 914us (1164us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784186517.298804:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1784186517.298866:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b9fed9f1c00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1784186517.298873:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937958144:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1784186517.299093:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784186517.299255:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186517.299265:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a629a60/0x55bc3e8c99d1932c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.299275:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128c00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186517.299280:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a629a60/0x55bc3e8c99d1932c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.299308:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a629a60/0x55bc3e8c99d1932c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.299330:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a629a60/0x55bc3e8c99d1932c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.299337:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a629a60/0x55bc3e8c99d1932c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186517.299367:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186517.299369:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186517.299371:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784186517.299758:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:3.0:1784186517.299862:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1784186517.299872:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1784186517.565839:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186517.694321:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937958656:0@lo:400:kworker.0 00000100:00100000:3.0:1784186517.694410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186517.694424:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937958400:0@lo:400:kworker.0 00000100:00100000:0.0:1784186517.694518:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937958656 00000100:00100000:0.0:1784186517.694529:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937958656 00000100:00100000:0.0:1784186517.694584:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784186517.694592:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937958656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186517.694698:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937958272:0@lo:400:kworker.0 00000100:00100000:1.0:1784186517.699367:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186517.699491:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937958400 00000100:00100000:1.0:1784186517.699501:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937958400 00000100:00100000:1.0:1784186517.699553:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784186517.699563:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937958400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186517.699636:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937958400:12345-0@lo:400:kworker.0 Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186517.699644:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784186517.699693:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937958400:0@lo:400:kworker.0 00000100:00100000:1.0:1784186517.699752:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937958528:0@lo:400:kworker.0 00000100:00100000:1.0:1784186517.699786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186517.699903:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937958528 00000100:00100000:1.0:1784186517.699907:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937958528 00000100:00100000:1.0:1784186517.699947:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784186517.699952:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937958528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186517.699995:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937958528:12345-0@lo:400:kworker.0 Request processed in 43us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186517.700001:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1784186517.700017:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186517.700032:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937958528:0@lo:400:kworker.0 00000100:00100000:0.0:1784186517.703678:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937958656:12345-0@lo:400:kworker.0 Request processed in 9073us (9255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186517.703694:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1784186517.704660:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fed9f3b80 x1870854937958656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186517.704679:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937958656:0@lo:400:kworker.0 00000100:00100000:2.0:1784186517.707512:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186517.707586:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937958784:0@lo:400:kworker.0 00000100:00100000:2.0:1784186517.707635:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186517.707877:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937958272 00000100:00100000:0.0:1784186517.707905:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937958272 00000100:00100000:0.0:1784186517.707980:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1784186517.707988:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:3308:x1870854937958272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186517.708053:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:3308:x1870854937958272:12345-0@lo:400:kworker.0 Request processed in 66us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186517.708060:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1784186517.708288:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937958272:0@lo:400:kworker.0 00000100:00100000:1.0:1784186517.708408:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937958784 00000100:00100000:1.0:1784186517.708413:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937958784 00000100:00100000:1.0:1784186517.708540:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784186517.708547:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937958784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186517.708604:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937958784:12345-0@lo:400:kworker.0 Request processed in 43us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186517.708611:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1784186517.708671:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186517.708693:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937958784:0@lo:400:kworker.0 10000000:01000000:1.0:1784186518.141721:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784186518.141730:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc9c79000 from 7 10000000:01000000:1.0:1784186518.141735:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784186518.141786:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186518.141799:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186518.141810:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186518.141836:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5497800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937958912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784186518.141905:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.142392:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937958912 00000100:00100000:0.0:1784186518.142400:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937958912 00000100:00100000:0.0:1784186518.142578:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1784186518.142589:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+16:5780:x1870854937958912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186518.142604:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186518.142619:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d1933a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d19333 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.142642:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d1933a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d19333 expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.142654:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d1933a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19333 expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.142663:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129600, rc 0) 00000100:00100000:0.0:1784186518.155801:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937958912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 13202us (13884us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.155815:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784186518.156356:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fca06f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186518.156387:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5497800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937958912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784186518.156413:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186518.156436:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186518.156531:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5497800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937959040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784186518.156587:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186518.156625:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fca06f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.156935:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937959040 00000100:00100000:0.0:1784186518.156942:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937959040 00000100:00100000:0.0:1784186518.156985:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1784186518.156995:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937959040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.157264:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937959040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.157278:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1784186518.157751:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5497800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937959040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784186518.157789:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5497800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937959168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784186518.157836:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186518.157866:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fca06f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.159061:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937959168 00000100:00100000:0.0:1784186518.159071:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937959168 00000100:00100000:0.0:1784186518.159121:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1784186518.159131:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937959168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.159366:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2facc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937959168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.159380:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1784186518.159810:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5497800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937959168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186518.160476:0:11516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11516:1870854937959296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186518.160543:0:11516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186518.160585:0:11516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd18080c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186518.160762:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937959296 00000100:00100000:2.0:1784186518.160768:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937959296 00000100:00100000:2.0:1784186518.160808:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1784186518.160816:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:11516:x1870854937959296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784186518.161022:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+17:11516:x1870854937959296:12345-0@lo:502:llog_process_th.0 Request processed in 207us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186518.161030:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1784186518.161201:0:11516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11516:1870854937959296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784186518.161236:0:11516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784186518.161246:0:11516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186518.161249:0:11516:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784186518.161257:0:11516:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b9fc9c79000 00000020:00000080:3.0:1784186518.161260:0:11516:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784186518.161683:0:11516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11516:1870854937959424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186518.161714:0:11516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186518.164005:0:11516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd199bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.166389:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937959424 00000100:00100000:0.0:1784186518.166402:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937959424 00000100:00100000:0.0:1784186518.166472:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1784186518.166485:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:11516:x1870854937959424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186518.168426:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:11516:x1870854937959424:12345-0@lo:502:llog_process_th.0 Request processed in 1933us (6698us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.168452:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1784186518.171800:0:11516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11516:1870854937959424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784186518.171853:0:11516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186518.171863:0:11516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186518.171867:0:11516:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784186518.171873:0:11516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784186518.175742:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1784186518.175775:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784186518.175787:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.175800:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186518.175811:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784186518.175814:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9ffef01800 from 7 10000000:01000000:0.0:1784186518.175816:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784186518.175852:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.175861:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.175872:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186518.175896:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937959552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.175972:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.176019:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc6fe99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.176041:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937959552 00000100:00100000:0.0:1784186518.176048:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937959552 00000100:00100000:0.0:1784186518.176101:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1784186518.176110:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+17:5780:x1870854937959552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186518.176123:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186518.176136:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19348 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d19341 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.176157:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19348 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d19341 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.176168:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19348 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d19341 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.176189:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129400, rc 0) 00000100:00100000:0.0:1784186518.176225:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937959552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.176232:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1784186518.176277:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937959552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186518.176292:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.176300:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186518.176356:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937959680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.176387:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.176402:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc6fe99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.176415:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937959680 00000100:00100000:0.0:1784186518.176429:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937959680 00000100:00100000:0.0:1784186518.176474:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1784186518.176482:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937959680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.176697:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2faf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937959680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.176704:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1784186518.176731:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937959680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.176755:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937959808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.176789:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.176803:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc6fe99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.176814:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937959808 00000100:00100000:0.0:1784186518.176817:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937959808 00000100:00100000:0.0:1784186518.176832:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1784186518.176837:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937959808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.176960:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937959808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.176967:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1784186518.177003:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937959808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.177222:0:11519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11519:1870854937959936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186518.177253:0:11519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.177272:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937959936 00000100:00100000:0.0:1784186518.177281:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937959936 00000100:00100000:0.0:1784186518.177302:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1784186518.177308:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:11519:x1870854937959936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186518.177459:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:11519:x1870854937959936:12345-0@lo:502:llog_process_th.0 Request processed in 131us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.177467:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1784186518.177493:0:11519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc6fe9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.177504:0:11519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11519:1870854937959936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186518.177522:0:11519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186518.177530:0:11519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186518.177532:0:11519:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784186518.177539:0:11519:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b9ffef01800 00000020:00000080:0.0:1784186518.177541:0:11519:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784186518.177604:0:11519:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11519:1870854937960064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186518.177636:0:11519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.177654:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937960064 00000100:00100000:0.0:1784186518.177657:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937960064 00000100:00100000:0.0:1784186518.177680:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1784186518.177685:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:11519:x1870854937960064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186518.177785:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:11519:x1870854937960064:12345-0@lo:502:llog_process_th.0 Request processed in 99us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.177791:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1784186518.177819:0:11519:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fefd10600 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.177831:0:11519:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11519:1870854937960064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186518.177847:0:11519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186518.177851:0:11519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186518.177858:0:11519:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784186518.177861:0:11519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784186518.177914:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1784186518.177928:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784186518.177936:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.177945:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186518.177954:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784186518.177956:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc5f8f800 from 7 10000000:01000000:0.0:1784186518.177959:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784186518.177979:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.177986:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.177994:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186518.178007:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937960192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.178032:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.178044:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffeca9000 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.178056:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937960192 00000100:00100000:0.0:1784186518.178059:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937960192 00000100:00100000:0.0:1784186518.178075:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1784186518.178080:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:5780:x1870854937960192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186518.178089:0:5775:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186518.178104:0:5775:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d19356 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1934f expref: -99 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.178122:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d19356 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1934f expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.178132:0:5775:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d19356 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1934f expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.178140:0:5775:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128c00, rc 0) 00000100:00100000:0.0:1784186518.178168:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937960192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.178174:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1784186518.178201:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937960192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186518.178213:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.178222:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186518.178256:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937960320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.178279:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.178292:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffeca9000 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.178302:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937960320 00000100:00100000:0.0:1784186518.178305:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937960320 00000100:00100000:0.0:1784186518.178322:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1784186518.178328:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937960320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.178527:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937960320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.178539:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1784186518.178569:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937960320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.178590:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937960448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.178622:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.178634:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffeca9000 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.178645:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937960448 00000100:00100000:0.0:1784186518.178647:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937960448 00000100:00100000:0.0:1784186518.178663:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784186518.178669:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937960448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.178768:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:5780:x1870854937960448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.178775:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784186518.178807:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fab6759c-e30b-4013-88b9-0b4d132afa93:5780:1870854937960448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784186518.185861:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784186518.210324:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937960576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186518.210416:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.210509:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937960576 00000100:00100000:0.0:1784186518.210516:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937960576 00000100:00100000:0.0:1784186518.210570:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784186518.210579:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1870854937960576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186518.210626:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186518.210671:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1870854937960576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.210677:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784186518.210739:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937960576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186518.211015:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11520:1870854937960704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186518.211068:0:11520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.211096:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937960704 00000100:00100000:0.0:1784186518.211100:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937960704 00000100:00100000:0.0:1784186518.211242:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1784186518.211250:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:11520:x1870854937960704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186518.211519:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:11520:x1870854937960704:12345-0@lo:502:llog_process_th.0 Request processed in 270us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.212391:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1784186518.212495:0:11520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffeca9840 going to sleep for 11 seconds 00000100:00100000:0.0:1784186518.212519:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11520:1870854937960704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186518.212551:0:11520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186518.212560:0:11520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186518.212562:0:11520:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784186518.212569:0:11520:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b9fc5f8f800 00000020:00000080:0.0:1784186518.212571:0:11520:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784186518.212895:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11520:1870854937960832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186518.213880:0:11520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186518.214920:0:11520:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc6fe9480 going to sleep for 11 seconds 00000100:00100000:2.0:1784186518.215178:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937960832 00000100:00100000:2.0:1784186518.215189:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937960832 00000100:00100000:2.0:1784186518.215250:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784186518.215259:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:11520:x1870854937960832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784186518.215555:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:11520:x1870854937960832:12345-0@lo:502:llog_process_th.0 Request processed in 296us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186518.215563:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784186518.216016:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fab6759c-e30b-4013-88b9-0b4d132afa93:11520:1870854937960832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186518.216050:0:11520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186518.216058:0:11520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186518.216060:0:11520:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784186518.216065:0:11520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1784186518.216246:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1784186518.216265:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784186518.216275:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186518.216387:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186518.590007:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186518.813666:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186518.813821:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915904768 00000100:00100000:2.0:1784186518.813832:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915904768 00000100:00100000:2.0:1784186518.813889:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 263 00000100:00100000:2.0:1784186518.813898:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:5572:x1870854915904768:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784186518.813914:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186518.813932:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc766ca00/0x55bc3e8c99d1935d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764be expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186518.813962:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766ca00/0x55bc3e8c99d1935d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764be expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186518.813973:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc766ca00/0x55bc3e8c99d1935d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764be expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186518.813983:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766ca00, rc 0) 00000100:00100000:2.0:1784186518.814049:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915904768:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 151us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186518.814056:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 263 00000100:00100000:0.0:1784186518.821418:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186518.821689:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915904896 00000100:00100000:2.0:1784186518.821701:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915904896 00000100:00100000:2.0:1784186518.821763:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 264 00000100:00100000:2.0:1784186518.821774:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915904896:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784186518.822134:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915904896:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 361us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186518.822143:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 264 00000100:00100000:3.0:1784186518.842094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186518.848109:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915905024 00000100:00100000:0.0:1784186518.848125:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915905024 00000100:00100000:0.0:1784186518.848202:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 265 00000100:00100000:0.0:1784186518.848213:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915905024:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186518.848744:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9092050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915905024:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 530us (6660us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.848754:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 265 00000100:00100000:0.0:1784186518.861027:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186518.861297:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915905152 00000100:00100000:2.0:1784186518.861306:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915905152 00000100:00100000:2.0:1784186518.861367:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 266 00000100:00100000:2.0:1784186518.861376:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:9933:x1870854915905152:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784186518.861664:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:9933:x1870854915905152:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 287us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186518.861674:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 266 00000100:00100000:1.0:1784186518.868297:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186518.869011:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915905280 00000100:00100000:2.0:1784186518.869022:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915905280 00000100:00100000:2.0:1784186518.869090:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 267 00000100:00100000:2.0:1784186518.869101:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:9933:x1870854915905280:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784186518.869751:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:9933:x1870854915905280:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 649us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186518.869759:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 267 00000100:00100000:3.0:1784186518.893848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186518.893960:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915905408 00000100:00100000:0.0:1784186518.893969:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915905408 00000100:00100000:0.0:1784186518.894035:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 268 00000100:00100000:0.0:1784186518.894046:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:5572:x1870854915905408:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186518.894065:0:5774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186518.894084:0:5774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19364 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764c5 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.894115:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764c5 expref: 13 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.894127:0:5774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764c5 expref: 13 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186518.894137:0:5774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129000, rc 0) 00000100:00100000:0.0:1784186518.894216:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:5572:x1870854915905408:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 172us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.894223:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 268 00000100:00100000:0.0:1784186518.898219:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186518.898397:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915905536 00000100:00100000:2.0:1784186518.898415:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915905536 00000100:00100000:2.0:1784186518.898495:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 269 00000100:00100000:2.0:1784186518.898506:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:5572:x1870854915905536:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784186518.900242:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:5572:x1870854915905536:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 1727us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186518.900254:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 269 00000100:00100000:1.0:1784186518.904991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186518.905146:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915905664 00000100:00100000:2.0:1784186518.905156:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915905664 00000100:00100000:2.0:1784186518.905268:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 270 00000100:00100000:2.0:1784186518.905278:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:5572:x1870854915905664:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784186518.905561:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:5572:x1870854915905664:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 284us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186518.905569:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 270 00000100:00100000:3.0:1784186518.915862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186518.917513:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915905792 00000100:00100000:0.0:1784186518.917528:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915905792 00000100:00100000:0.0:1784186518.917595:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 271 00000100:00100000:0.0:1784186518.917606:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:9936:x1870854915905792:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784186518.917872:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:9936:x1870854915905792:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 268us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186518.917881:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 271 00000100:00100000:3.0:1784186518.922560:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186518.922666:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915905920 00000100:00100000:2.0:1784186518.922676:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915905920 00000100:00100000:2.0:1784186518.922742:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 272 00000100:00100000:2.0:1784186518.922752:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:9936:x1870854915905920:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784186518.923009:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:9936:x1870854915905920:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 258us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186518.923017:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 272 00000040:00080000:1.0:1784186519.231938:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784186519.613710:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186519.888001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186519.888029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186519.888052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186519.888114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186519.888162:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915906304 00000100:00100000:1.0:1784186519.888172:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915906304 00000100:00100000:1.0:1784186519.888233:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:2.0:1784186519.888420:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915906176 00000100:00100000:2.0:1784186519.888424:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915906176 00000100:00100000:2.0:1784186519.888475:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915906432 00000100:00100000:2.0:1784186519.888478:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915906432 00000100:00100000:2.0:1784186519.888494:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:2.0:1784186519.888499:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915906176:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186519.888560:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915906176:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 61us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186519.888565:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:2.0:1784186519.888577:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 103 00000100:00100000:2.0:1784186519.888581:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2355:x1870854915906432:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186519.888607:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2355:x1870854915906432:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186519.888611:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 103 00000100:00080000:2.0:1784186519.888624:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784186519.888627:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784186519.889073:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915906304:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186519.889114:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915906304:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 874us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186519.889120:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:0.0:1784186519.890110:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915906048 00000100:00100000:0.0:1784186519.890119:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915906048 00000100:00100000:0.0:1784186519.890178:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 273 00000100:00100000:0.0:1784186519.890186:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2355:x1870854915906048:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186519.891908:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2355:x1870854915906048:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 56us (2187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186519.891940:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 273 00010000:00010000:3.0:1784186520.638716:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186521.661666:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186521.790767:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784186521.790792:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937960960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784186521.790862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186521.791001:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937960960 00000100:00100000:0.0:1784186521.791011:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937960960 00000100:00100000:0.0:1784186521.791083:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784186521.791093:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937960960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784186521.791128:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186521.791176:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937960960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186521.791183:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1784186521.791266:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5494a80 x1870854937960960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186537 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186521.791295:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937960960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784186521.791360:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1784186522.404731:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1784186522.687632:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186522.815124:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854937961344:0@lo:400:kworker.0 00000100:00100000:3.0:1784186522.815229:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186522.815303:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784186522.815310:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937961216:0@lo:400:kworker.0 00000100:00100000:3.0:1784186522.815349:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186522.815365:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937961728:0@lo:400:kworker.0 00000100:00100000:3.0:1784186522.815391:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186522.815431:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937961344 00000100:00100000:3.0:1784186522.815457:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937961344 00000100:00100000:3.0:1784186522.815516:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937961216 00000100:00100000:3.0:1784186522.815519:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937961216 00000100:00100000:3.0:1784186522.815542:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784186522.815551:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854937961344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186522.815605:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854937961344:12345-0@lo:400:kworker.0 Request processed in 55us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186522.815612:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784186522.815639:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784186522.815646:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937961216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186522.815672:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937961216:12345-0@lo:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186522.815678:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1784186522.815701:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186522.815737:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937961216:0@lo:400:kworker.0 00000100:00100000:3.0:1784186522.815746:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854937961344:0@lo:400:kworker.0 00000100:00100000:2.0:1784186522.815962:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937961472:0@lo:400:kworker.0 00000100:00100000:2.0:1784186522.815993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186522.816024:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784186522.816029:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937961088:0@lo:400:kworker.0 00000100:00100000:2.0:1784186522.816054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186522.816082:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1870854937961600:0@lo:400:kworker.0 00000100:00100000:2.0:1784186522.816103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186522.816129:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937961600 00000100:00100000:2.0:1784186522.816133:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937961600 00000100:00100000:2.0:1784186522.816166:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784186522.816173:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870854937961600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186522.816208:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870854937961600:12345-0@lo:400:kworker.0 Request processed in 36us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186522.816214:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1784186522.816230:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186522.816246:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1870854937961600:0@lo:400:kworker.0 00000100:00100000:1.0:1784186522.816328:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937961728 00000100:00100000:1.0:1784186522.816332:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937961728 00000100:00100000:1.0:1784186522.816380:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937961472 00000100:00100000:1.0:1784186522.816392:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937961472 00000100:00100000:1.0:1784186522.816410:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784186522.816417:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937961728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186522.816484:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937961728:12345-0@lo:400:kworker.0 Request processed in 66us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186522.816490:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784186522.816506:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784186522.816512:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937961472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186522.816545:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937961472:12345-0@lo:400:kworker.0 Request processed in 34us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186522.816551:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1784186522.816584:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc2e69f80 x1870854937961472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186522.816595:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937961472:0@lo:400:kworker.0 00000100:00100000:1.0:1784186522.816616:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1784186522.816622:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b9fed9f1c00, transno 4294967300 00000100:00100000:1.0:1784186522.816631:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937961728:0@lo:400:kworker.0 00000100:00080000:2.0:1784186522.816736:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186522.817206:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937961088 00000100:00100000:3.0:1784186522.817211:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937961088 00000100:00100000:3.0:1784186522.817249:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1784186522.817273:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3306:x1870854937961088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186522.817323:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3306:x1870854937961088:12345-0@lo:400:kworker.0 Request processed in 53us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186522.817330:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1784186522.817422:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937961088:0@lo:400:kworker.0 00000100:00100000:1.0:1784186523.326491:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937961856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186523.326703:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186523.326981:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937961856 00000100:00100000:3.0:1784186523.326989:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937961856 00000100:00100000:3.0:1784186523.327037:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784186523.327047:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937961856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784186523.327697:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186523.328287:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937961856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1238us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186523.328297:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784186523.328712:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937961856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784186523.709892:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186524.741476:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186525.018968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186525.019070:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186525.019087:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186525.019108:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186525.019135:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915906688 00000100:00100000:2.0:1784186525.019144:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915906688 00000100:00100000:2.0:1784186525.019198:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915906944 00000100:00100000:2.0:1784186525.019201:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915906944 00000100:00100000:2.0:1784186525.019219:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00100000:2.0:1784186525.019239:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915906688:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186525.019311:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915906688:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186525.019319:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00100000:2.0:1784186525.019334:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 108 00000100:00100000:2.0:1784186525.019350:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2356:x1870854915906944:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186525.019370:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2356:x1870854915906944:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 31us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186525.019376:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 108 00000100:00080000:2.0:1784186525.019392:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186525.020290:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915906816 00000100:00100000:1.0:1784186525.020298:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915906816 00000100:00100000:1.0:1784186525.020355:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:1.0:1784186525.020363:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915906816:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186525.020426:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915906816:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 64us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186525.020434:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00080000:2.0:1784186525.021713:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186525.027383:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915906560 00000100:00100000:3.0:1784186525.027399:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915906560 00000100:00100000:3.0:1784186525.027498:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 275 00000100:00100000:3.0:1784186525.027509:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915906560:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186525.027924:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915906560:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 416us (8964us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186525.027934:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 275 00010000:00010000:3.0:1784186525.757765:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186526.785977:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186526.909862:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186526.909888:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937961984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784186526.909966:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186526.910056:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937961984 00000100:00100000:3.0:1784186526.910066:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937961984 00000100:00100000:3.0:1784186526.910144:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784186526.910150:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1784186526.910153:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937961984:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186526.910158:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1784186526.910206:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186526.910275:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937961984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186526.910283:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1784186526.910373:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5497480 x1870854937961984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186542 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186526.910399:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937961984:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784186526.910414:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784186527.809982:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186527.939673:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937962496:0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.939754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186527.939809:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784186527.939816:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937962112:0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.939844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186527.939867:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1870854937962624:0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.939899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186527.939927:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937962240:0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.939952:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186527.939970:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937962752:0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.939991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186527.940010:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784186527.940016:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937962368:0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.940038:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186527.940065:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937962496 00000100:00100000:2.0:1784186527.940071:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937962496 00000100:00100000:2.0:1784186527.940115:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937962752 00000100:00100000:2.0:1784186527.940119:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937962752 00000100:00100000:2.0:1784186527.940145:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784186527.940153:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937962496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.940214:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937962496:12345-0@lo:400:kworker.0 Request processed in 61us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186527.940222:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784186527.940238:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784186527.940244:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937962752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.940273:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937962752:12345-0@lo:400:kworker.0 Request processed in 30us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186527.940279:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784186527.940295:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937962112 00000100:00100000:2.0:1784186527.940299:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937962112 00000100:00100000:2.0:1784186527.940322:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1784186527.940328:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3306:x1870854937962112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.940366:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3306:x1870854937962112:12345-0@lo:400:kworker.0 Request processed in 38us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186527.940372:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1784186527.940398:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937962624 00000100:00100000:2.0:1784186527.940402:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937962624 00000100:00100000:2.0:1784186527.940426:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937962240 00000100:00100000:2.0:1784186527.940428:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937962240 00000100:00100000:2.0:1784186527.940438:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937962368 00000100:00100000:2.0:1784186527.940460:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937962368 00000100:00100000:2.0:1784186527.940476:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784186527.940481:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870854937962624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.940509:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870854937962624:12345-0@lo:400:kworker.0 Request processed in 28us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186527.940515:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784186527.940524:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784186527.940530:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937962240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.940553:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937962240:12345-0@lo:400:kworker.0 Request processed in 24us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186527.940559:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1784186527.940568:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784186527.940574:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937962368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.940597:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937962368:12345-0@lo:400:kworker.0 Request processed in 24us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186527.940602:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1784186527.940629:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784186527.940633:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784186527.940667:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937962368:0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.940687:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937962240:0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.940696:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937962752:0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.940729:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937962112:0@lo:400:kworker.0 00000100:00100000:2.0:1784186527.940738:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1870854937962624:0@lo:400:kworker.0 00010000:00080000:2.0:1784186527.940751:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fed9f3480 x1870854937962496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186527.940760:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937962496:0@lo:400:kworker.0 00000100:00100000:1.0:1784186528.445684:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937962880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186528.445772:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186528.445911:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937962880 00000100:00100000:3.0:1784186528.445920:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937962880 00000100:00100000:3.0:1784186528.445973:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784186528.445983:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937962880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784186528.446026:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186528.446075:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937962880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186528.446082:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784186528.446342:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937962880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784186528.829822:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784186529.470550:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784186529.853899:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186530.128203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186530.128508:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915907072 00000100:00100000:3.0:1784186530.128520:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915907072 00000100:00100000:3.0:1784186530.129791:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 277 00000100:00100000:3.0:1784186530.129804:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915907072:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186530.129901:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915907072:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 100us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186530.129910:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 277 00000100:00100000:0.0:1784186530.136568:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186530.136692:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186530.136834:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186530.136904:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915907328 00000100:00100000:1.0:1784186530.136913:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915907328 00000100:00100000:1.0:1784186530.136992:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:1.0:1784186530.137003:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915907328:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186530.137083:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915907328:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186530.137090:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00080000:0.0:1784186530.137319:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784186530.137719:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915907200 00000100:00100000:2.0:1784186530.137726:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915907200 00000100:00100000:2.0:1784186530.137775:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915907456 00000100:00100000:2.0:1784186530.137779:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915907456 00000100:00100000:2.0:1784186530.137802:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 112 00000100:00100000:2.0:1784186530.137810:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2357:x1870854915907200:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186530.137852:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2357:x1870854915907200:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 43us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186530.137858:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 112 00000100:00100000:2.0:1784186530.137870:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 113 00000100:00100000:2.0:1784186530.137876:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915907456:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186530.137898:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915907456:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186530.137904:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 113 00000100:00080000:0.0:1784186530.138241:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784186530.877747:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186531.905385:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186532.029856:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937963008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784186532.029934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186532.030122:0:11527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937963008 00000100:00100000:3.0:1784186532.030137:0:11527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937963008 00000100:00100000:3.0:1784186532.030206:0:11527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784186532.030216:0:11527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937963008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784186532.030255:0:11527:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186532.030296:0:11527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937963008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186532.030314:0:11527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1784186532.032017:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784186532.032078:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5497100 x1870854937963008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186532.032102:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937963008:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784186532.925707:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186533.053861:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854937963392:0@lo:400:kworker.0 00000100:00100000:1.0:1784186533.053925:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186533.053988:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784186533.053995:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937963264:0@lo:400:kworker.0 00000100:00100000:1.0:1784186533.054026:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186533.054039:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937963776:0@lo:400:kworker.0 00000100:00100000:0.0:1784186533.054249:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937963136:0@lo:400:kworker.0 00000100:00100000:0.0:1784186533.054282:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186533.054313:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854937963648:0@lo:400:kworker.0 00000100:00100000:0.0:1784186533.054332:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186533.054349:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186533.054353:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937963520:0@lo:400:kworker.0 00000100:00100000:0.0:1784186533.054372:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186533.054403:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937963392 00000100:00100000:0.0:1784186533.054410:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937963392 00000100:00100000:0.0:1784186533.054487:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937963264 00000100:00100000:0.0:1784186533.054490:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937963264 00000100:00100000:0.0:1784186533.054503:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937963648 00000100:00100000:0.0:1784186533.054506:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937963648 00000100:00100000:0.0:1784186533.054520:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784186533.054528:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854937963392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186533.054570:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854937963392:12345-0@lo:400:kworker.0 Request processed in 43us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186533.054577:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784186533.054590:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784186533.054595:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937963264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186533.054614:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937963264:12345-0@lo:400:kworker.0 Request processed in 19us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186533.054626:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784186533.054636:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784186533.054640:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1870854937963648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186533.054665:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1870854937963648:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186533.054671:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784186533.054707:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854937963648:0@lo:400:kworker.0 00000100:00100000:2.0:1784186533.054921:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937963520 00000100:00100000:2.0:1784186533.054926:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937963520 00000100:00100000:2.0:1784186533.054962:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784186533.054969:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937963520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186533.055019:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937963520:12345-0@lo:400:kworker.0 Request processed in 49us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186533.055025:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1784186533.055043:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784186533.055073:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5496300 x1870854937963520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186533.055085:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937963520:0@lo:400:kworker.0 00000100:00100000:3.0:1784186533.055327:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937963136 00000100:00100000:3.0:1784186533.055332:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937963136 00000100:00100000:3.0:1784186533.055367:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1784186533.055374:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3307:x1870854937963136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186533.055414:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3307:x1870854937963136:12345-0@lo:400:kworker.0 Request processed in 40us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186533.055420:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1784186533.055617:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186533.055653:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854937963392:0@lo:400:kworker.0 00000100:00100000:1.0:1784186533.055669:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937963264:0@lo:400:kworker.0 00000100:00100000:0.0:1784186533.055729:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937963776 00000100:00100000:0.0:1784186533.055733:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937963776 00000100:00100000:0.0:1784186533.055774:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784186533.055780:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937963776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186533.055813:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937963776:12345-0@lo:400:kworker.0 Request processed in 34us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186533.055818:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1784186533.055902:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784186533.055920:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937963776:0@lo:400:kworker.0 00000100:00100000:2.0:1784186533.055993:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937963136:0@lo:400:kworker.0 00000100:00100000:1.0:1784186533.568833:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937963904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186533.568914:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186533.569034:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937963904 00000100:00100000:2.0:1784186533.569043:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937963904 00000100:00100000:2.0:1784186533.569122:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784186533.569133:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937963904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784186533.569172:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186533.569217:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937963904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186533.569244:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784186533.569338:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937963904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784186533.950159:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186534.974153:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186535.248614:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186535.248661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186535.248761:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915907712 00000100:00100000:1.0:1784186535.248772:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915907712 00000100:00100000:1.0:1784186535.248848:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:1.0:1784186535.248876:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915907712:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186535.248961:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915907712:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186535.248970:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00080000:2.0:1784186535.249533:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186535.249825:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915907584 00000100:00100000:3.0:1784186535.249832:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915907584 00000100:00100000:2.0:1784186535.251395:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 279 00000100:00100000:2.0:1784186535.251429:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915907584:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186535.251799:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915907584:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 391us (3205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186535.251808:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 279 00000100:00100000:0.0:1784186535.263943:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186535.263996:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186535.264282:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915907968 00000100:00100000:2.0:1784186535.264292:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915907968 00000100:00100000:2.0:1784186535.264368:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:2.0:1784186535.264377:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915907968:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186535.264494:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915907968:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 117us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186535.264501:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00080000:3.0:1784186535.266783:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186535.271115:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915907840 00000100:00100000:1.0:1784186535.271198:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915907840 00000100:00100000:1.0:1784186535.271601:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:1.0:1784186535.271613:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2353:x1870854915907840:12345-192.168.201.31@tcp:9:kworker.0 00000020:00000080:1.0:1784186535.271645:0:6581:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d192a0 00000100:00080000:1.0:1784186535.271654:0:6581:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeda7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784186535.271698:0:6581:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1784186535.271988:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+2:2353:x1870854915907840:12345-192.168.201.31@tcp:9:kworker.0 Request processed in 376us (7989us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186535.272012:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00010000:00010000:0.0:1784186535.273905:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784186535.275798:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784186535.997777:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186537.021847:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186537.149867:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784186537.149900:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937964032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784186537.149983:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186537.150141:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937964032 00000100:00100000:0.0:1784186537.150149:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937964032 00000100:00100000:0.0:1784186537.150218:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784186537.150228:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937964032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784186537.150270:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186537.150321:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937964032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186537.150344:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1784186537.150530:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784186537.150562:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fe5497b80 x1870854937964032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186537.150583:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937964032:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1784186537.741908:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00000020:00000080:3.0:1784186537.741919:0:7480:0:(genops.c:906:class_export_put()) final put ffff9b9ffeda4000/efb6eb2c-5579-43c6-be4f-310412860e5b 00000020:00000080:2.0:1784186537.741990:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffeda4000/efb6eb2c-5579-43c6-be4f-310412860e5b for lustre-OST0001 00000020:00000080:2.0:1784186537.742305:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ffeda7800 for lustre-OST0001 00010000:00010000:0.0:1784186538.045730:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186538.173748:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937964288:0@lo:400:kworker.0 00000100:00100000:2.0:1784186538.173748:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937964544:0@lo:400:kworker.0 00000100:00100000:1.0:1784186538.173810:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937964160:0@lo:400:kworker.0 00000100:00100000:3.0:1784186538.173886:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186538.173954:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937964800:0@lo:400:kworker.0 00000100:00100000:3.0:1784186538.173980:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186538.174021:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784186538.174027:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937964416:0@lo:400:kworker.0 00000100:00100000:3.0:1784186538.174049:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186538.174082:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937964288 00000100:00100000:3.0:1784186538.174090:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937964288 00000100:00100000:3.0:1784186538.174131:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937964416 00000100:00100000:3.0:1784186538.174133:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937964416 00000100:00100000:3.0:1784186538.174157:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784186538.174164:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937964288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186538.174208:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937964288:12345-0@lo:400:kworker.0 Request processed in 44us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186538.174215:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784186538.174243:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784186538.174248:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937964416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186538.174269:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937964416:12345-0@lo:400:kworker.0 Request processed in 21us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186538.174274:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1784186538.174291:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186538.174316:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937964416:0@lo:400:kworker.0 00000100:00100000:3.0:1784186538.174326:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937964288:0@lo:400:kworker.0 00000100:00100000:2.0:1784186538.178462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186538.178550:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937964800 00000100:00100000:2.0:1784186538.178559:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937964800 00000100:00100000:3.0:1784186538.178737:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937964544 00000100:00100000:3.0:1784186538.178741:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937964544 00000100:00100000:1.0:1784186538.178861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186538.178891:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854937964672:0@lo:400:kworker.0 00000100:00100000:1.0:1784186538.178921:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186538.185112:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784186538.185138:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937964800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186538.185261:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937964800:12345-0@lo:400:kworker.0 Request processed in 137us (11279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186538.185269:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1784186538.185289:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784186538.185297:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937964544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186538.185339:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937964544:12345-0@lo:400:kworker.0 Request processed in 43us (6883us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186538.185345:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784186538.185388:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937964672 00000100:00100000:3.0:1784186538.185395:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937964672 00000100:00100000:3.0:1784186538.185463:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784186538.185471:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1870854937964672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186538.185509:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1870854937964672:12345-0@lo:400:kworker.0 Request processed in 40us (6587us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186538.185515:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784186538.187722:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937964800:0@lo:400:kworker.0 00000100:00080000:2.0:1784186538.189748:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784186538.189759:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784186538.189779:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937964160 00000100:00100000:2.0:1784186538.189788:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937964160 00000100:00100000:2.0:1784186538.189854:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1784186538.189863:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3307:x1870854937964160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186538.189958:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3307:x1870854937964160:12345-0@lo:400:kworker.0 Request processed in 97us (11097us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186538.189965:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1784186538.190714:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854937964672:0@lo:400:kworker.0 00000100:00100000:3.0:1784186538.190751:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937964160:0@lo:400:kworker.0 00010000:00080000:2.0:1784186538.191089:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc2e69c00 x1870854937964544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186538.191101:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937964544:0@lo:400:kworker.0 00000100:00100000:1.0:1784186538.686477:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784186538.686505:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937964928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186538.686589:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186538.686753:0:11527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937964928 00000100:00100000:0.0:1784186538.686760:0:11527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937964928 00000100:00100000:0.0:1784186538.686814:0:11527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784186538.686823:0:11527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937964928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186538.686858:0:11527:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186538.686916:0:11527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937964928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186538.686924:0:11527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784186538.687015:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937964928:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784186539.069677:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784186539.711331:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784186540.099582:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186540.396105:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186540.396160:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186540.396199:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186540.396367:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915908224 00000100:00100000:3.0:1784186540.396378:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915908224 00000100:00100000:3.0:1784186540.396504:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915908352 00000100:00100000:3.0:1784186540.396508:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915908352 00000100:00100000:3.0:1784186540.396534:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:3.0:1784186540.396545:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915908224:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186540.396654:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915908224:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 110us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186540.396663:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:3.0:1784186540.396697:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:3.0:1784186540.396704:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915908352:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186540.396730:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915908352:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186540.396737:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:0.0:1784186540.397021:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915908096 00000100:00100000:0.0:1784186540.397027:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915908096 00000100:00100000:0.0:1784186540.397077:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 281 00000100:00100000:0.0:1784186540.397084:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2357:x1870854915908096:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186540.397116:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2357:x1870854915908096:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 32us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186540.397122:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 281 00000100:00080000:2.0:1784186540.397747:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784186541.119129:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784186542.137815:0:11686:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:22:20 (1784186540) 00010000:00010000:1.0:1784186542.142428:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186542.269711:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186542.269737:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937965056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784186542.269809:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186542.270024:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937965056 00000100:00100000:3.0:1784186542.270032:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937965056 00000100:00100000:3.0:1784186542.270100:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784186542.270111:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937965056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784186542.270147:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186542.270197:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937965056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186542.270204:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1784186542.270300:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fc9c5a300 x1870854937965056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186542.270320:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937965056:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784186542.270378:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784186543.166358:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186543.293719:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffede4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854937965440:0@lo:400:kworker.0 00000100:00100000:1.0:1784186543.293792:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186543.293857:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784186543.293865:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937965312:0@lo:400:kworker.0 00000100:00100000:1.0:1784186543.293888:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186543.293906:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937965824:0@lo:400:kworker.0 00000100:00100000:1.0:1784186543.293940:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186543.293978:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937965440 00000100:00100000:1.0:1784186543.293987:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937965440 00000100:00100000:1.0:1784186543.294074:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937965312 00000100:00100000:1.0:1784186543.294077:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937965312 00000100:00100000:1.0:1784186543.294100:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1784186543.294109:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854937965440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186543.294189:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854937965440:12345-0@lo:400:kworker.0 Request processed in 81us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186543.294197:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1784186543.294215:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1784186543.294221:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937965312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186543.294245:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937965312:12345-0@lo:400:kworker.0 Request processed in 24us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186543.294251:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1784186543.294271:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937965824 00000100:00100000:1.0:1784186543.294274:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937965824 00000100:00100000:1.0:1784186543.294299:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784186543.294306:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937965824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186543.294331:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937965824:12345-0@lo:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186543.294337:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1784186543.294352:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186543.294356:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186543.294389:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937965312:0@lo:400:kworker.0 00000100:00100000:1.0:1784186543.294400:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937965824:0@lo:400:kworker.0 00000100:00100000:1.0:1784186543.294409:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffede4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854937965440:0@lo:400:kworker.0 00000100:00100000:0.0:1784186543.294711:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937965184:0@lo:400:kworker.0 00000100:00100000:0.0:1784186543.294751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186543.294785:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854937965696:0@lo:400:kworker.0 00000100:00100000:0.0:1784186543.294804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186543.294826:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186543.294831:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937965568:0@lo:400:kworker.0 00000100:00100000:0.0:1784186543.294850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186543.294902:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937965696 00000100:00100000:3.0:1784186543.294907:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937965696 00000100:00100000:3.0:1784186543.294951:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784186543.294957:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1870854937965696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186543.294990:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1870854937965696:12345-0@lo:400:kworker.0 Request processed in 33us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186543.295005:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1784186543.295165:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937965568 00000100:00100000:2.0:1784186543.295169:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937965568 00000100:00100000:2.0:1784186543.295198:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784186543.295204:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937965568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186543.295233:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937965568:12345-0@lo:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186543.295239:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1784186543.295335:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784186543.295357:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9fefd1ed80 x1870854937965568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784186559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186543.295370:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937965568:0@lo:400:kworker.0 00000100:00100000:0.0:1784186543.295378:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854937965696:0@lo:400:kworker.0 00000100:00100000:1.0:1784186543.298503:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937965184 00000100:00100000:1.0:1784186543.298518:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937965184 00000100:00100000:1.0:1784186543.298578:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1784186543.298589:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3307:x1870854937965184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186543.298706:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3307:x1870854937965184:12345-0@lo:400:kworker.0 Request processed in 118us (3952us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186543.298729:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1784186543.299225:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937965184:0@lo:400:kworker.0 00000100:00100000:3.0:1784186543.809772:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784186543.809798:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937965952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784186543.809883:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186543.810221:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937965952 00000100:00100000:0.0:1784186543.810229:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937965952 00000100:00100000:0.0:1784186543.810284:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784186543.810294:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937965952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186543.810330:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186543.810389:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937965952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186543.810396:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784186543.810486:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937965952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186543.895972:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186543.896215:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915908480 00000100:00100000:2.0:1784186543.896237:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915908480 00000100:00100000:2.0:1784186543.896321:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:2.0:1784186543.896332:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:10205:x1870854915908480:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186543.896352:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186543.896377:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1936b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764cc expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.896468:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19372 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.896481:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.896494:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186543.896680:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784186543.896684:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186543.896768:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.896791:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1936b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764cc expref: 7 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.896807:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19372 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764cc expref: 6 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.896815:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc5142600) 00010000:00010000:2.0:1784186543.896818:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784186543.896822:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d600, rc 0) 00000100:00080000:0.0:1784186543.896985:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186543.897159:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:10205:x1870854915908480:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 826us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186543.897167:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:0.0:1784186543.910199:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186543.910315:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915908608 00000100:00100000:3.0:1784186543.910327:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915908608 00000100:00100000:3.0:1784186543.910392:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:3.0:1784186543.910403:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:10206:x1870854915908608:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186543.910424:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186543.910476:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19379 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764d3 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.910537:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19380 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.910551:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19380 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.910567:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19380 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.910582:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19387 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.910588:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.910595:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912410:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505400/0x55bc3e8c99d1938e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912429:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505400/0x55bc3e8c99d1938e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912465:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505400/0x55bc3e8c99d1938e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186543.912545:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784186543.912548:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186543.912613:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505400/0x55bc3e8c99d1938e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912624:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19380 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912630:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19380 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912638:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19380 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912644:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186543.912648:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19380 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912655:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19380 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912667:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc5142600) 00010000:00010000:3.0:1784186543.912669:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186543.912673:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19380 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912680:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19380 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912701:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912707:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19387 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912713:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19387 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912718:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505a00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186543.912721:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19387 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912726:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19387 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912733:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b9fc7718400) 00010000:00010000:3.0:1784186543.912735:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186543.912738:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19387 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912743:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19387 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912786:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764d3 expref: 8 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912799:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505400/0x55bc3e8c99d1938e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764d3 expref: 7 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186543.912815:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b9fc7718f00) 00010000:00010000:3.0:1784186543.912817:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186543.912820:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505400, rc 0) 00000100:00100000:3.0:1784186543.912890:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:10206:x1870854915908608:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 2488us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186543.912898:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:0.0:1784186543.922769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186543.925315:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915908864 00000100:00100000:2.0:1784186543.925332:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915908864 00000100:00100000:2.0:1784186543.925408:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:2.0:1784186543.925420:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:10206:x1870854915908864:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186543.925464:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186543.925488:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19395 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764da expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.925572:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1939c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.925588:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1939c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.925599:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1939c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.925655:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d193a3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.925661:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d193a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.925666:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d193a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926189:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c800/0x55bc3e8c99d193aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926201:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c800/0x55bc3e8c99d193aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926207:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c800/0x55bc3e8c99d193aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186543.926216:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1784186543.926369:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1939c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926374:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1939c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926379:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1939c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926384:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186543.926389:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1939c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926396:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1939c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926409:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b9fc7718f00) 00010000:00010000:2.0:1784186543.926411:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186543.926416:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1939c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926422:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1939c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926435:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d193a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926499:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d193a3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926505:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d193a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926511:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186543.926514:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d193a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926521:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d193a3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926528:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b9fc5142700) 00010000:00010000:2.0:1784186543.926531:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186543.926534:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d193a3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926539:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d193a3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926853:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19395 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764da expref: 10 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926865:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c800/0x55bc3e8c99d193aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764da expref: 9 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186543.926871:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:2.0:1784186543.926873:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186543.926878:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c800, rc 0) 00000100:00100000:2.0:1784186543.926965:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+9:10206:x1870854915908864:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 1546us (4207us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784186543.926973:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:1.0:1784186543.931776:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186543.933087:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915908992 00000100:00100000:2.0:1784186543.933100:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915908992 00000100:00100000:3.0:1784186543.933235:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:3.0:1784186543.933250:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+9:10206:x1870854915908992:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784186543.933545:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+9:10206:x1870854915908992:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 Request processed in 299us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186543.933554:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00010000:00010000:1.0:1784186544.197591:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784186544.842227:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784186545.213630:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186545.496960:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186545.497021:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186545.497056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186545.497086:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915909376 00000100:00100000:2.0:1784186545.497096:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915909376 00000100:00100000:2.0:1784186545.497159:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915909248 00000100:00100000:2.0:1784186545.497163:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915909248 00000100:00100000:3.0:1784186545.497176:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915909120 00000100:00100000:3.0:1784186545.497180:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915909120 00000100:00100000:2.0:1784186545.497187:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 127 00000100:00100000:2.0:1784186545.497196:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915909376:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186545.497211:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 283 00000100:00100000:3.0:1784186545.497218:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915909120:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186545.497282:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915909120:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 64us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186545.497291:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 283 00000100:00100000:2.0:1784186545.499283:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915909376:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 2078us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186545.499296:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 127 00000100:00100000:2.0:1784186545.499343:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 128 00000100:00100000:2.0:1784186545.499358:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2354:x1870854915909248:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186545.499407:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2354:x1870854915909248:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 56us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186545.499413:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 128 00000100:00080000:2.0:1784186545.499435:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186546.098814:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186546.099568:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915909504 00000100:00100000:2.0:1784186546.099580:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915909504 00000100:00100000:2.0:1784186546.099643:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:2.0:1784186546.099653:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+9:10249:x1870854915909504:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186546.099674:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186546.099694:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764e1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.099761:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.099775:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.099789:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.099804:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.099811:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.099818:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101471:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101488:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101494:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101510:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186546.101515:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101523:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101538:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc5142600) 00010000:00010000:2.0:1784186546.101541:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186546.101546:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101552:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101564:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101569:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101574:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101579:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766cc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186546.101582:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101587:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101603:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b9fc5142700) 00010000:00010000:2.0:1784186546.101605:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186546.101608:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101613:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101654:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764e1 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101665:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc5142600) 00010000:00010000:2.0:1784186546.101666:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186546.101670:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764e1 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.101681:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d400, rc 0) 00000100:00100000:2.0:1784186546.101767:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+9:10249:x1870854915909504:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 2114us (2961us total) trans 0 rc 301/301 00000100:00100000:2.0:1784186546.101777:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:2.0:1784186546.115611:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186546.115691:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915909760 00000100:00100000:0.0:1784186546.115700:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915909760 00000100:00100000:0.0:1784186546.115762:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:0.0:1784186546.115783:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+9:10249:x1870854915909760:12345-192.168.201.31@tcp:36:lfs.0 00010000:00010000:0.0:1784186546.115845:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186546.115892:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d19372 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764cc expref: 9 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.115915:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc5142600) 00010000:00010000:0.0:1784186546.115926:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784186546.116375:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d193cd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.116390:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d193cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.116399:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d193cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.116412:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d193d4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.116419:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d193d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.116424:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d193d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186546.121342:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1784186546.122110:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d193cd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.122271:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d193cd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.122297:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d193cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.122303:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129a00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186546.122307:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d193cd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.122315:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d193cd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.122332:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011ab00) 00010000:00010000:0.0:1784186546.122335:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186546.122339:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d193cd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.122344:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d193cd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784186546.122366:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2ddf3e4 reply state 000000005c61d8df transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d193d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186546.122375:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784186546.122543:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+10:10249:x1870854915909760:12345-192.168.201.31@tcp:36:lfs.0 Request processed in 6757us (6936us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784186546.122552:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 37 00010000:00010000:3.0:1784186546.142268:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d193d4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.142288:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d193d4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.142296:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d193d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.142309:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186546.142314:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d193d4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.142321:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d193d4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.142338:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b9fd011a300) 00010000:00010000:3.0:1784186546.142341:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186546.142345:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d193d4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.143277:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d193d4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.247708:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186546.273246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.273494:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915909888 00000100:00100000:3.0:1784186546.273504:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915909888 00000100:00100000:3.0:1784186546.273566:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:3.0:1784186546.273577:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+9:10257:x1870854915909888:12345-192.168.201.31@tcp:101:lctl.0 00010000:00010000:3.0:1784186546.273603:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186546.273627:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d193db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764e8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.273699:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d193e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.273714:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d193e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.273744:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d193e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186546.273807:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784186546.273811:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186546.273864:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d193e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.273899:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d193db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764e8 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.273919:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d193e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764e8 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.273929:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:3.0:1784186546.273932:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186546.273936:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505600, rc 0) 00000100:00100000:3.0:1784186546.274030:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+10:10257:x1870854915909888:12345-192.168.201.31@tcp:101:lctl.0 Request processed in 454us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186546.274037:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:0.0:1784186546.333292:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186546.333572:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915910016 00000100:00100000:2.0:1784186546.333584:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915910016 00000100:00100000:2.0:1784186546.333652:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:2.0:1784186546.333662:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+10:10263:x1870854915910016:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1784186546.333688:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186546.333725:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764ef expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.333787:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.333803:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.333816:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.333833:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.333840:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.333857:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.333996:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d193fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.334183:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d193fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.334191:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d193fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186546.334228:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1784186546.334232:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186546.334269:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d193fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.334287:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.334293:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.334299:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.334305:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186546.334309:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.334316:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.334329:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:2.0:1784186546.334332:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186546.334337:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.334343:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d193f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.335502:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.335514:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.335520:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.335537:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186546.335540:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.335546:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.335559:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9b9fc5142700) 00010000:00010000:2.0:1784186546.335561:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186546.335565:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.335571:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d193f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.335617:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d193e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764ef expref: 12 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.335632:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d193fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764ef expref: 11 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.335640:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:2.0:1784186546.335642:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784186546.335644:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d600, rc 0) 00000100:00100000:1.0:1784186546.336416:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+11:10263:x1870854915910016:12345-192.168.201.31@tcp:101:bash.0 Request processed in 2749us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186546.336426:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:1.0:1784186546.341082:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.341942:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915910272 00000100:00100000:3.0:1784186546.342067:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915910272 00000100:00100000:3.0:1784186546.342431:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:3.0:1784186546.342539:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+11:10263:x1870854915910272:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1784186546.342561:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186546.342584:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19405 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764f6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.342742:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1940c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.342758:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1940c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.342770:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1940c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.342786:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19413 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.342793:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.342800:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784186546.343773:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1784186546.344263:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1941a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.344278:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1941a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.344292:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1941a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.344328:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1940c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.344345:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1940c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.344352:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1940c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.344358:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186546.344362:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1940c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.344370:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1940c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.344381:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186546.344385:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186546.344389:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1940c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.344395:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1940c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784186546.344410:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ab156c6 reply state 00000000da8c088b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186546.344420:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784186546.344602:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19405 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764f6 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.344620:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1941a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764f6 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.344640:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718000) 00010000:00010000:3.0:1784186546.344643:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186546.344645:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505c00, rc 0) 00000100:00100000:3.0:1784186546.344769:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+14:10263:x1870854915910272:12345-192.168.201.31@tcp:101:bash.0 Request processed in 2326us (3924us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1784186546.344777:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 40 00010000:00010000:1.0:1784186546.350497:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.350518:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19413 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.350525:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.350533:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186546.350539:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.350547:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19413 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.350566:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fc7718200) 00010000:00010000:1.0:1784186546.350569:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186546.350574:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19413 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.350597:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19413 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186546.351394:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186546.351556:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915910400 00000100:00100000:2.0:1784186546.351566:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915910400 00000100:00100000:2.0:1784186546.351616:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:2.0:1784186546.351624:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1870854915910400:12345-192.168.201.31@tcp:8:bash.0 00010000:00080000:2.0:1784186546.351665:0:6584:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:2.0:1784186546.351692:0:6584:0:(genops.c:1406:class_connect()) connect: client efb6eb2c-5579-43c6-be4f-310412860e5b, cookie 0x55bc3e8c99d19428 00002000:00100000:2.0:1784186546.351703:0:6584:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli efb6eb2c-5579-43c6-be4f-310412860e5b/ffff9b9fd10eb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784186546.351726:0:6584:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784186546.352957:0:6584:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784186546.352997:0:6584:0:(import.c:65:import_set_state_nolock()) ffff9b9fd10ed800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784186546.353285:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2353:x1870854915910400:12345-192.168.201.31@tcp:8:bash.0 Request processed in 1658us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186546.353295:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:2.0:1784186546.356206:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.356310:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915910528 00000100:00100000:3.0:1784186546.356320:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915910528 00000100:00100000:3.0:1784186546.356517:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:3.0:1784186546.356529:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:0:x1870854915910528:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1784186546.356548:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186546.356574:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d1942f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5764fd expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784186546.356603:0:6581:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186546.356621:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:3.0:1784186546.356626:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186546.356636:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d1942f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764fd expref: 7 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.356656:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d1942f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764fd expref: 7 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.356669:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505a00, rc 0) 00000100:00100000:3.0:1784186546.356730:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:0:x1870854915910528:12345-192.168.201.31@tcp:101:bash.0 Request processed in 204us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186546.356750:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00080000:2.0:1784186546.356969:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784186546.360653:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186546.360743:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915910656 00000100:00100000:2.0:1784186546.360751:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915910656 00000100:00100000:2.0:1784186546.360802:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:2.0:1784186546.360810:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:10263:x1870854915910656:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1784186546.360827:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186546.360854:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576504 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.360895:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d1942f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764fd expref: 8 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.360904:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186546.360909:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186546.360914:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.360971:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d1942f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764fd expref: 8 pid: 6581 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.360985:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d1942f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764fd expref: 8 pid: 6581 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186546.361005:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6584:1870854937966080:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186546.361229:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd629e840 going to sleep for 11 seconds 00000100:00100000:2.0:1784186546.363579:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6584:1870854937966080:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186546.363614:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.363634:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766cc00, rc 0) 00000100:00100000:2.0:1784186546.363685:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:10263:x1870854915910656:12345-192.168.201.31@tcp:101:bash.0 Request processed in 2875us (3042us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186546.363693:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:1.0:1784186546.366064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.366295:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915910784 00000100:00100000:3.0:1784186546.366305:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915910784 00010000:00010000:3.0:1784186546.366349:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d1942f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764fd expref: 8 pid: 6581 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186546.366395:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:3.0:1784186546.366404:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2357:x1870854915910784:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186546.366419:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186546.366477:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d1942f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764fd expref: 8 pid: 6581 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.366493:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d1942f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764fd expref: 8 pid: 6581 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.366515:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d1942f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764fd expref: 8 pid: 6581 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.366532:0:5767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186546.366536:0:5767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186546.366545:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.366555:0:5767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.366614:0:5767:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186546.366629:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5767:1870854937966208:192.168.201.31@tcp:105: 00000100:00100000:3.0:1784186546.366706:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5414480 going to sleep for 11 seconds 00000100:00100000:0.0:1784186546.371705:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.371802:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5767:1870854937966208:192.168.201.31@tcp:105: 00010000:00010000:3.0:1784186546.371827:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186546.371906:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2357:x1870854915910784:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 5502us (5851us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186546.371916:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:1.0:1784186546.372021:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915911040 00000100:00100000:1.0:1784186546.372029:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915911040 00000100:00100000:1.0:1784186546.372081:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1784186546.372091:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+13:10263:x1870854915911040:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:1.0:1784186546.372419:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+14:10263:x1870854915911040:12345-192.168.201.31@tcp:35:bash.0 Request processed in 329us (723us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1784186546.372426:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:0.0:1784186546.458733:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186546.458849:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915911296 00000100:00100000:2.0:1784186546.458860:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915911296 00000100:00100000:2.0:1784186546.458934:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:2.0:1784186546.458956:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+14:10273:x1870854915911296:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186546.458984:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186546.459006:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1943d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57650b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186546.459162:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1784186546.459300:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1943d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57650b expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.459316:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:2.0:1784186546.459319:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784186546.459325:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1943d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57650b expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.459340:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c600, rc 0) 00000100:00100000:2.0:1784186546.459405:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+15:10273:x1870854915911296:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 462us (685us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1784186546.459414:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:2.0:1784186546.463659:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.463813:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915911552 00000100:00100000:3.0:1784186546.463823:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915911552 00000100:00100000:3.0:1784186546.463907:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1784186546.463918:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+15:10273:x1870854915911552:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186546.464203:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+16:10273:x1870854915911552:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 286us (559us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1784186546.464212:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:0.0:1784186546.555429:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186546.555695:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915911680 00000100:00100000:2.0:1784186546.555704:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915911680 00000100:00100000:2.0:1784186546.555764:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:2.0:1784186546.555775:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+16:10279:x1870854915911680:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186546.555798:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186546.555820:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1944b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576512 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.555909:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19452 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.555923:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.555952:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186546.556023:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1784186546.556027:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186546.556050:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.556075:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1944b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576512 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.556094:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576512 expref: 17 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.556103:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:2.0:1784186546.556105:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784186546.556121:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c000, rc 0) 00000100:00100000:2.0:1784186546.556234:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+17:10279:x1870854915911680:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 461us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186546.556242:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:0.0:1784186546.560799:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186546.561095:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915911936 00000100:00100000:2.0:1784186546.561105:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915911936 00000100:00100000:2.0:1784186546.561233:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:2.0:1784186546.561242:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+17:10279:x1870854915911936:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186546.561264:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186546.561284:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19459 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576519 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.562183:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.562201:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.562212:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186546.562224:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784186546.562458:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19459 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576519 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.562480:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576519 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.562489:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718000) 00010000:00010000:2.0:1784186546.562492:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186546.562496:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d800, rc 0) 00000100:00100000:2.0:1784186546.562606:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+19:10279:x1870854915911936:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1363us (1815us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1784186546.562614:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:1.0:1784186546.566540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186546.568336:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.568429:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915912320 00000100:00100000:3.0:1784186546.568438:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915912320 00000100:00100000:3.0:1784186546.568530:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:3.0:1784186546.568542:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+19:2355:x1870854915912320:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186546.568557:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186546.568583:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576519 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.568616:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718000) 00010000:00010000:3.0:1784186546.568620:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186546.568732:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+18:2355:x1870854915912320:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 192us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186546.568740:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:2.0:1784186546.569772:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915912192 00000100:00100000:2.0:1784186546.569780:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915912192 00000100:00100000:2.0:1784186546.569823:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:2.0:1784186546.569831:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+18:10279:x1870854915912192:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186546.569872:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186546.569900:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1946e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576520 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.570284:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19475 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.570300:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.570311:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19475 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186546.570324:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784186546.570580:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1946e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576520 expref: 21 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.570599:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19475 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576520 expref: 20 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.570607:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718000) 00010000:00010000:2.0:1784186546.570610:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784186546.570613:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766ce00, rc 0) 00000100:00100000:2.0:1784186546.570662:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+20:10279:x1870854915912192:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 831us (4136us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1784186546.570670:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:1.0:1784186546.578651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.578762:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915912448 00000100:00100000:3.0:1784186546.578773:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915912448 00000100:00100000:3.0:1784186546.578831:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:3.0:1784186546.578840:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2356:x1870854915912448:12345-192.168.201.31@tcp:1:lfs.0 00010000:00010000:3.0:1784186546.578902:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.578922:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.578931:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186546.578935:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784186546.579199:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.579239:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 7 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.579254:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 7 pid: 6584 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186546.579284:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870854937966336:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186546.579416:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5414480 going to sleep for 11 seconds 00000100:00100000:1.0:1784186546.587208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.587408:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870854937966336:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186546.587436:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186546.587841:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915912576 00000100:00100000:0.0:1784186546.587850:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915912576 00002000:00100000:0.0:1784186546.587906:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b9ffe273100 x1870854915912576/t0(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:2/0 lens 504/0 e 0 to 0 dl 1784186557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784186546.587918:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ffe273100 with x1870854915912576 ext(0->12) 00010000:00010000:0.0:1784186546.587926:0:6587:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 8 pid: 6584 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.587950:0:6587:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 8 pid: 6584 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784186546.587959:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b9ffe273100 00000100:00100000:0.0:1784186546.587990:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:0.0:1784186546.588010:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2356:x1870854915912576:12345-192.168.201.31@tcp:4:lfs.0 00000001:00100000:3.0:1784186546.616328:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00000100:00100000:0.0:1784186546.616989:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe273100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2356:x1870854915912576:12345-192.168.201.31@tcp:4:lfs.0 Request processed in 28974us (29784us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1784186546.617014:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00002000:00100000:0.0:1784186546.617029:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9b9ffe273100 x1870854915912576/t4294967299(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:2/0 lens 504/448 e 0 to 0 dl 1784186557 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784186546.617041:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ffe273100 with x1870854915912576 ext(0->12) 00010000:00010000:0.0:1784186546.617050:0:6587:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 9 pid: 6584 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.617067:0:6587:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 9 pid: 6584 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784186546.617083:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b9ffe273100 00000100:00100000:0.0:1784186546.620267:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186546.620387:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915912704 00000100:00100000:2.0:1784186546.620400:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915912704 00010000:00010000:2.0:1784186546.620475:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 9 pid: 6584 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186546.620544:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:2.0:1784186546.620554:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5578e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2355:x1870854915912704:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186546.620569:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784186546.620588:0:11003:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784186546.620591:0:11003:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784186546 00002000:00010000:2.0:1784186546.620593:0:11003:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1784186546 00002000:00010000:2.0:1784186546.620595:0:11003:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784186546 00010000:00010000:2.0:1784186546.620601:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 9 pid: 6584 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.620614:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 9 pid: 6584 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.620639:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009abb177b/0x55bc3e8c99d19436 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576504 expref: 9 pid: 6584 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.620655:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186546.620659:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186546.620666:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.620677:0:11003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.620711:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186546.620768:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5578e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2355:x1870854915912704:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 215us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186546.620776:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 36 00010000:00010000:1.0:1784186546.621234:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.621245:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.621271:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.621280:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.621301:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.621308:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505a00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186546.621313:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.621323:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.621339:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186546.621347:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af68e09d/0x55bc3e8c99d19483 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186546.621427:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2356:x1870854915912448:12345-192.168.201.31@tcp:1:lfs.0 Request processed in 42587us (42786us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186546.621435:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:0.0:1784186546.626579:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.626710:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915912960 00000100:00100000:3.0:1784186546.626722:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915912960 00000100:00100000:3.0:1784186546.626787:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:3.0:1784186546.626798:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+20:10279:x1870854915912960:12345-192.168.201.31@tcp:35:lfs.0 00000004:00010000:3.0:1784186546.626883:0:5786:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19475 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576520 expref: 20 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784186546.627220:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1784186546.627279:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1784186546.628018:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1784186546.628084:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.628103:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1941a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764f6 expref: 24 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.628113:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.628163:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1941a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764f6 expref: 24 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.628179:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1941a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764f6 expref: 24 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186546.628196:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5786:1870854937966464:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186546.628303:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5411840 going to sleep for 11 seconds 00000100:00100000:2.0:1784186546.633059:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186546.633279:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915913088 00000100:00100000:0.0:1784186546.633289:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915913088 00010000:00010000:0.0:1784186546.633332:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1941a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764f6 expref: 25 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186546.633375:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:0.0:1784186546.633384:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+25:2357:x1870854915913088:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186546.633399:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186546.633406:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1941a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764f6 expref: 25 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.633419:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1941a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764f6 expref: 25 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.633481:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718000) 00010000:00010000:0.0:1784186546.633487:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.633496:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.633503:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.633540:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186546.633592:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+25:2357:x1870854915913088:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 209us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186546.633601:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 37 00010000:00010000:3.0:1784186546.634066:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1941a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764f6 expref: 24 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186546.634086:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5786:1870854937966464:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186546.634121:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.634131:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.634137:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784186546.634278:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1784186546.634554:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1784186546.634696:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5786:1870854937966592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784186546.634774:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186546.634809:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5411480 going to sleep for 11 seconds 00000100:00100000:1.0:1784186546.635055:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937966592 00000100:00100000:1.0:1784186546.635062:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937966592 00000100:00100000:1.0:1784186546.635126:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784186546.635137:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5786:x1870854937966592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784186546.635217:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5786:x1870854937966592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 82us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186546.635234:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1784186546.635387:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784186546.635432:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5786:1870854937966592:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1784186546.636627:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1784186546.636706:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5786:1870854937966720:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1784186546.636759:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186546.636833:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5411840 going to sleep for 11 seconds 00000100:00100000:1.0:1784186546.637767:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937966720 00000100:00100000:1.0:1784186546.637777:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937966720 00000100:00100000:1.0:1784186546.638249:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784186546.638261:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5786:x1870854937966720:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1784186546.638541:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5786:x1870854937966720:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 281us (1780us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784186546.638549:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784186546.638657:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5786:1870854937966720:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1784186546.638728:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1784186546.638775:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.638786:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.638794:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.638800:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186546.638805:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.638813:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.638828:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718000) 00010000:00010000:0.0:1784186546.638831:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784186546.638836:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.638842:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1948a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784186546.639086:0:5786:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784186546.639621:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1784186546.639633:0:5786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325361191296ns, next at 326361189361ns, rc = 0 00000001:00080000:0.0:1784186546.639641:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1784186546.639678:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718000) 00010000:00010000:0.0:1784186546.639682:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784186546.639690:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19475 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576520 expref: 28 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186546.639807:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+27:10279:x1870854915912960:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 13010us (13241us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1784186546.639820:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000020:00080000:0.0:1784186546.639824:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1784186546.643538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.643634:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915913216 00000100:00100000:3.0:1784186546.643646:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915913216 00000100:00100000:3.0:1784186546.643701:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:3.0:1784186546.643713:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+27:10279:x1870854915913216:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186546.643739:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186546.643763:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576527 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.643829:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576527 expref: 28 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.643844:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576527 expref: 28 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.643876:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186546.643879:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784186546.643883:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505e00, rc 0) 00000100:00100000:3.0:1784186546.643952:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+28:10279:x1870854915913216:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 241us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186546.643960:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:2.0:1784186546.647951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186546.648019:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915913472 00000100:00100000:0.0:1784186546.648029:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915913472 00000100:00100000:0.0:1784186546.648088:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1784186546.648100:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+28:10279:x1870854915913472:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1784186546.648362:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+29:10279:x1870854915913472:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 263us (421us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1784186546.648371:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1784186546.729980:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186546.730295:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915913728 00000100:00100000:2.0:1784186546.730307:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915913728 00000100:00100000:2.0:1784186546.730563:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:2.0:1784186546.730575:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+29:10289:x1870854915913728:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186546.730600:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186546.730624:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57652e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186546.730756:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1784186546.730886:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19498 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57652e expref: 31 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.730900:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:2.0:1784186546.730903:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784186546.730908:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57652e expref: 31 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186546.730924:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766da00, rc 0) 00000100:00100000:2.0:1784186546.731004:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+30:10289:x1870854915913728:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 423us (1028us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1784186546.731012:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:2.0:1784186546.733175:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.733430:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915913856 00000100:00100000:3.0:1784186546.733620:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915913856 00000100:00100000:3.0:1784186546.733703:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:3.0:1784186546.733716:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+30:10289:x1870854915913856:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:3.0:1784186546.733786:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d194a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.733800:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d194a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.733807:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d194a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.733818:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d194ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.733823:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d194ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.733826:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d194ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.733935:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.733943:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.733950:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784186546.738389:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738425:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d194a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738463:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d194a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738472:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d194a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738478:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186546.738483:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d194a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738490:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d194a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738510:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186546.738513:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186546.738519:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d194a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738525:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d194a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738546:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d194ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738553:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d194ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738558:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d194ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738561:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186546.738569:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d194ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738573:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d194ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738579:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fc7718b00) 00010000:00010000:3.0:1784186546.738581:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186546.738583:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d194ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738587:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d194ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738617:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738620:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738624:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738627:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186546.738629:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738632:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738636:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186546.738637:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186546.738643:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186546.738647:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186546.738765:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+30:10289:x1870854915913856:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 5045us (5600us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186546.738777:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:1.0:1784186546.740958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.741041:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915914112 00000100:00100000:3.0:1784186546.741051:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915914112 00000100:00100000:3.0:1784186546.741098:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:3.0:1784186546.741105:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+30:10289:x1870854915914112:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186546.741330:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+31:10289:x1870854915914112:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 225us (383us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1784186546.741336:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:3.0:1784186546.776588:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186546.777071:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915914368 00000100:00100000:0.0:1784186546.777080:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915914368 00000100:00100000:0.0:1784186546.777198:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:0.0:1784186546.777209:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+31:10292:x1870854915914368:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186546.777232:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186546.777268:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576535 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777341:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d194c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777366:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d194c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777377:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d194c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777392:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d194c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777398:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d194c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777404:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d194c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777576:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d194d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777586:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d194d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777593:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d194d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186546.777604:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784186546.777690:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d194c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777718:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d194c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777725:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d194c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777732:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186546.777736:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d194c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777744:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d194c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777755:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:0.0:1784186546.777758:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186546.777763:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d194c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777770:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d194c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777782:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d194c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777788:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d194c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777793:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d194c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777799:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186546.777805:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d194c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777812:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d194c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777818:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fd011ac00) 00010000:00010000:0.0:1784186546.777820:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186546.777823:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d194c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777828:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d194c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777883:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576535 expref: 34 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777906:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d194d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576535 expref: 33 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.777914:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:0.0:1784186546.777916:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784186546.777918:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128600, rc 0) 00000100:00100000:0.0:1784186546.777975:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+33:10292:x1870854915914368:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 769us (1400us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1784186546.777983:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:2.0:1784186546.788428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186546.788649:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915914496 00000100:00100000:0.0:1784186546.788659:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915914496 00000100:00100000:0.0:1784186546.789241:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:0.0:1784186546.789254:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+33:10292:x1870854915914496:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:0.0:1784186546.789348:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.789366:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.789378:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.789406:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.789413:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.789419:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.789425:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129a00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186546.789429:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.789436:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.789486:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:0.0:1784186546.789490:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784186546.789495:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186546.789501:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d194de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186546.789596:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+33:10292:x1870854915914496:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 343us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186546.789605:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:1.0:1784186546.793567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186546.793667:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915914752 00000100:00100000:3.0:1784186546.793679:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915914752 00000100:00100000:3.0:1784186546.793907:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:3.0:1784186546.793918:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+33:10292:x1870854915914752:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186546.794469:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+34:10292:x1870854915914752:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 521us (880us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1784186546.794481:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:1.0:1784186547.079650:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186547.079759:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915915008 00000100:00100000:2.0:1784186547.079769:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915915008 00000100:00100000:2.0:1784186547.079841:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:2.0:1784186547.079852:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+34:10323:x1870854915915008:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:2.0:1784186547.079917:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186547.079941:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d194e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57653c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.080059:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d194ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.080074:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d194ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.080085:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d194ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186547.080096:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784186547.080237:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d194e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57653c expref: 37 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.080257:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d194ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57653c expref: 36 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.080266:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:2.0:1784186547.080269:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186547.080273:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766dc00, rc 0) 00000100:00100000:2.0:1784186547.080340:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+36:10323:x1870854915915008:12345-192.168.201.31@tcp:101:cat.0 Request processed in 490us (701us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1784186547.080370:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00080000:3.0:1784186547.080898:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186547.084503:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186547.085846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186547.085999:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915915392 00000100:00100000:2.0:1784186547.086012:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915915392 00000100:00100000:2.0:1784186547.086081:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:2.0:1784186547.086091:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe55b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+36:2355:x1870854915915392:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186547.086107:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186547.086130:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d194ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57653c expref: 36 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.086148:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:2.0:1784186547.086153:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186547.086208:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe55b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+35:2355:x1870854915915392:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 118us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186547.086216:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:0.0:1784186547.087748:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915915264 00000100:00100000:0.0:1784186547.087760:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915915264 00000100:00100000:0.0:1784186547.088251:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:0.0:1784186547.088264:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+35:10323:x1870854915915264:12345-192.168.201.31@tcp:35:cat.0 00000100:00100000:0.0:1784186547.098212:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+36:10323:x1870854915915264:12345-192.168.201.31@tcp:35:cat.0 Request processed in 593us (4358us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1784186547.098236:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:1.0:1784186547.173121:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186547.173366:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915915648 00000100:00100000:3.0:1784186547.173376:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915915648 00000100:00100000:3.0:1784186547.173479:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:3.0:1784186547.173505:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+36:10329:x1870854915915648:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:3.0:1784186547.173529:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186547.173532:0:7478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784186547.173557:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19452 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576512 expref: 36 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.173578:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186547.173583:0:7478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186547.173597:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576543 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.173688:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.173702:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d194d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576535 expref: 36 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.173710:0:7478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.173744:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d194d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576535 expref: 36 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.173756:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d194d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576535 expref: 36 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186547.173768:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937966848:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186547.173865:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5411240 going to sleep for 11 seconds 00000100:00100000:2.0:1784186547.182376:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186547.182438:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915915776 00000100:00100000:0.0:1784186547.182486:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915915776 00010000:00010000:0.0:1784186547.182527:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d194d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576535 expref: 37 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186547.182566:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:0.0:1784186547.182576:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+37:2356:x1870854915915776:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186547.182591:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186547.182599:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d194d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576535 expref: 37 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.182613:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d194d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576535 expref: 37 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.182637:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:0.0:1784186547.182659:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.182670:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.182677:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.182699:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186547.182740:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+37:2356:x1870854915915776:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 165us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186547.182748:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 38 00010000:00010000:3.0:1784186547.184232:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d194d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576535 expref: 36 pid: 5783 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186547.184255:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937966848:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186547.184280:0:7478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.184291:0:7478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.184297:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186547.184316:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784186547.184642:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d194fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576543 expref: 37 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.184659:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576543 expref: 36 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.184668:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186547.184671:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784186547.184673:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504200, rc 0) 00000100:00100000:3.0:1784186547.184742:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+36:10329:x1870854915915648:12345-192.168.201.31@tcp:101:dd.0 Request processed in 11239us (11641us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1784186547.184749:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:2.0:1784186547.188671:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186547.188802:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915916032 00000100:00100000:3.0:1784186547.188814:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915916032 00000100:00100000:3.0:1784186547.188897:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:3.0:1784186547.188920:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+36:10329:x1870854915916032:12345-192.168.201.31@tcp:36:dd.0 00010000:00010000:3.0:1784186547.189326:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1950f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.189344:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1950f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.189368:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1950f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784186547.189421:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1784186547.190079:0:5782:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033ffe85d reply state 00000000341bd4d5 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1950f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186547.190091:0:5782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784186547.190367:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+39:10329:x1870854915916032:12345-192.168.201.31@tcp:36:dd.0 Request processed in 1446us (1704us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1784186547.190376:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 52 00000020:00080000:3.0:1784186547.190382:0:5782:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784186547.193407:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1950f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.193423:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1950f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.193431:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1950f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.193436:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186547.193560:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1950f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.193586:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1950f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.193603:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186547.193606:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186547.193611:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1950f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.193618:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1950f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.261895:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186547.390383:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186547.390409:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937966976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784186547.390515:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186547.390847:0:11527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937966976 00000100:00100000:1.0:1784186547.390866:0:11527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937966976 00000100:00100000:1.0:1784186547.390923:0:11527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784186547.390933:0:11527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854937966976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784186547.390960:0:11527:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186547.391018:0:11527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854937966976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186547.391025:0:11527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784186547.391129:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937966976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784186547.450551:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186547.450716:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915916160 00000100:00100000:0.0:1784186547.450726:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915916160 00000100:00100000:0.0:1784186547.450784:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:0.0:1784186547.450793:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+38:10343:x1870854915916160:12345-192.168.201.31@tcp:101:stat.0 00010000:00010000:0.0:1784186547.450816:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186547.450836:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d19516 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57654a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.450911:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1951d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.450925:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1951d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.451135:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1951d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.451150:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.451158:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.451165:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.451264:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.451283:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576543 expref: 39 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.451292:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.451326:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576543 expref: 39 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.451340:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576543 expref: 39 pid: 7478 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186547.451353:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5784:1870854937967104:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186547.451650:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc913d300 going to sleep for 11 seconds 00000100:00100000:2.0:1784186547.457839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186547.457975:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915916416 00000100:00100000:3.0:1784186547.457985:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915916416 00000100:00100000:3.0:1784186547.458046:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:3.0:1784186547.458056:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+40:5570:x1870854915916416:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784186547.458619:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+41:5570:x1870854915916416:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 563us (786us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1784186547.458628:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:0.0:1784186547.463382:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5784:1870854937967104:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186547.463413:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186547.466187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186547.466330:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915916544 00000100:00100000:2.0:1784186547.466340:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915916544 00010000:00010000:2.0:1784186547.466380:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576543 expref: 41 pid: 7478 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186547.466427:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:2.0:1784186547.466437:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe270e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+41:2356:x1870854915916544:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186547.466503:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186547.466512:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576543 expref: 41 pid: 7478 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.466527:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576543 expref: 41 pid: 7478 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.466552:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19501 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576543 expref: 41 pid: 7478 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.466571:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:2.0:1784186547.466576:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.466586:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.466594:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.466628:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186547.466697:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe270e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+40:2356:x1870854915916544:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 261us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186547.466706:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00010000:00010000:0.0:1784186547.467554:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467567:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186547.467612:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1784186547.467617:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186547.467653:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467667:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467675:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1951d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467692:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1951d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467699:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1951d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467705:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186547.467709:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1951d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467715:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1951d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467739:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:0.0:1784186547.467742:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186547.467746:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1951d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467752:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1951d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467764:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467771:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19524 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467776:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467781:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186547.467784:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467790:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19524 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467798:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fd011ac00) 00010000:00010000:0.0:1784186547.467800:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186547.467803:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19524 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467809:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467877:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d19516 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57654a expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467891:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57654a expref: 39 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.467899:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:0.0:1784186547.467901:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784186547.467904:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129c00, rc 0) 00000100:00100000:0.0:1784186547.467963:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+39:10343:x1870854915916160:12345-192.168.201.31@tcp:101:stat.0 Request processed in 17170us (17424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186547.467970:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:1.0:1784186547.582663:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186547.583557:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915916800 00000100:00100000:0.0:1784186547.583569:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915916800 00000100:00100000:0.0:1784186547.583637:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:0.0:1784186547.583648:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+39:10349:x1870854915916800:12345-192.168.201.31@tcp:36:truncate.0 00010000:00010000:0.0:1784186547.583710:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186547.584234:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1952b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57654a expref: 39 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.584258:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:0.0:1784186547.584263:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186547.585229:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19532 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.585247:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.585275:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784186547.585335:0:5783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1784186547.585366:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018bdbe83 reply state 000000005da1ec35 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186547.585375:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186547.585655:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+41:10349:x1870854915916800:12345-192.168.201.31@tcp:36:truncate.0 Request processed in 2005us (2998us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1784186547.585663:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 54 00000020:00080000:2.0:1784186547.585669:0:5783:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784186547.600002:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19532 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.600044:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19532 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.600052:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.600059:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766cc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186547.600064:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19532 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.600072:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19532 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.600091:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:1.0:1784186547.600094:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186547.600099:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19532 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.600104:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19532 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186547.762906:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186547.763279:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915916928 00000100:00100000:3.0:1784186547.763290:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915916928 00000100:00100000:3.0:1784186547.763355:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:3.0:1784186547.763366:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+40:10363:x1870854915916928:12345-192.168.201.31@tcp:101:stat.0 00010000:00010000:3.0:1784186547.763392:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186547.763414:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576551 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763525:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19540 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763539:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763550:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763564:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763572:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763578:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763692:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763700:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763706:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186547.763741:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1784186547.763745:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186547.763767:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763788:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763796:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763802:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19540 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763809:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763815:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186547.763819:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763840:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19540 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763862:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186547.763865:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186547.763869:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763875:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763888:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763894:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19547 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763905:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763911:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186547.763914:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763920:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19547 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763939:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fc7718b00) 00010000:00010000:3.0:1784186547.763941:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186547.763944:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19547 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763948:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.763993:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576551 expref: 42 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.764005:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576551 expref: 41 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.764011:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186547.764013:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186547.764015:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505a00, rc 0) 00000100:00100000:3.0:1784186547.764213:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+41:10363:x1870854915916928:12345-192.168.201.31@tcp:101:stat.0 Request processed in 849us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186547.764231:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:2.0:1784186547.851269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186547.852513:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915917184 00000100:00100000:3.0:1784186547.852527:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915917184 00000100:00100000:3.0:1784186547.852627:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:3.0:1784186547.852635:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+41:10373:x1870854915917184:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186547.852653:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186547.852671:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576558 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186547.852784:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1784186547.852902:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19555 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576558 expref: 43 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.852914:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:3.0:1784186547.852916:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784186547.852919:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576558 expref: 43 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.852932:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505c00, rc 0) 00000100:00100000:3.0:1784186547.852999:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+42:10373:x1870854915917184:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 365us (1741us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1784186547.853004:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:1.0:1784186547.857208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186547.857287:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915917440 00000100:00100000:2.0:1784186547.857296:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915917440 00000100:00100000:2.0:1784186547.857362:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1784186547.857372:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+42:10373:x1870854915917440:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1784186547.857861:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+43:10373:x1870854915917440:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 488us (657us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1784186547.857870:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:3.0:1784186547.926264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186547.926567:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915917696 00000100:00100000:0.0:1784186547.926579:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915917696 00000100:00100000:0.0:1784186547.926646:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:0.0:1784186547.926657:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+43:10379:x1870854915917696:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1784186547.926709:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186547.926890:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19563 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57655f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.926991:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.927007:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576551 expref: 44 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.927015:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.927062:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576551 expref: 44 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186547.927076:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576551 expref: 44 pid: 7478 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186547.927089:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5784:1870854937967232:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186547.927295:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc913dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186547.934881:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5784:1870854937967232:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186547.934913:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186547.939486:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186547.939618:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915917824 00000100:00100000:3.0:1784186547.939628:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915917824 00010000:00010000:3.0:1784186547.939670:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576551 expref: 45 pid: 7478 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186547.939726:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:3.0:1784186547.939747:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+45:2356:x1870854915917824:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186547.939765:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186547.939774:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576551 expref: 45 pid: 7478 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.939790:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576551 expref: 45 pid: 7478 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.939812:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1954e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576551 expref: 45 pid: 7478 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.939828:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186547.939833:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.939851:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.939859:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.939884:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186547.939946:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+44:2356:x1870854915917824:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 211us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186547.939954:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 40 00010000:00010000:3.0:1784186547.939997:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.940005:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186547.940023:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1784186547.940306:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19563 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57655f expref: 45 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.940323:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57655f expref: 44 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.940330:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186547.940333:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784186547.940335:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129a00, rc 0) 00000100:00100000:3.0:1784186547.940362:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+44:10379:x1870854915917696:12345-192.168.201.31@tcp:101:bash.0 Request processed in 13708us (14109us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1784186547.940369:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:2.0:1784186547.949605:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186547.949641:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915918080 00000100:00100000:2.0:1784186547.949651:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915918080 00000100:00100000:2.0:1784186547.949714:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:2.0:1784186547.949724:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+44:10379:x1870854915918080:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:2.0:1784186547.950499:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19578 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.950530:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.950541:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784186547.950601:0:5783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1784186547.950627:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000632c4bd8 reply state 000000005964f239 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186547.950637:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186547.950939:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+47:10379:x1870854915918080:12345-192.168.201.31@tcp:36:bash.0 Request processed in 1213us (1342us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1784186547.950948:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 58 00000020:00080000:2.0:1784186547.950953:0:5783:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784186547.958762:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.958780:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19578 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.958787:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.958813:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186547.958818:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.958826:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19578 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.958854:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186547.958857:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186547.958862:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19578 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.958868:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19578 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186547.959979:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186547.961088:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915918208 00000100:00100000:1.0:1784186547.961110:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915918208 00000100:00100000:1.0:1784186547.961168:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:1.0:1784186547.961178:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+46:10379:x1870854915918208:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1784186547.961201:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186547.961220:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1957f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576566 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.961311:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19586 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.961326:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57655f expref: 47 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.961335:0:7478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19586 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.961380:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57655f expref: 47 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186547.961394:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57655f expref: 47 pid: 5784 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186547.961410:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe271c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937967360:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186547.961514:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186547.964972:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186547.965005:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915918336 00000100:00100000:3.0:1784186547.965013:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915918336 00010000:00010000:3.0:1784186547.965063:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57655f expref: 48 pid: 5784 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186547.965287:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe271c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937967360:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186547.965314:0:7478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19586 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186547.965365:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:3.0:1784186547.965377:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+48:2357:x1870854915918336:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186547.965395:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186547.965403:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57655f expref: 48 pid: 5784 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.965437:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57655f expref: 48 pid: 5784 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.965603:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d1956a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57655f expref: 48 pid: 5784 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.965620:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186547.965625:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19586 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.965635:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.965644:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19586 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186547.965665:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186547.965874:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+47:2357:x1870854915918336:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 499us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186547.965884:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 41 00010000:00010000:2.0:1784186547.972334:0:7478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.972354:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186547.972409:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784186547.972415:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186547.972469:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.972528:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d1957f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576566 expref: 47 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.972549:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19586 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576566 expref: 46 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186547.972559:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:2.0:1784186547.972562:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186547.972566:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27edc00, rc 0) 00000100:00100000:2.0:1784186547.972640:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+46:10379:x1870854915918208:12345-192.168.201.31@tcp:101:bash.0 Request processed in 11462us (12668us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186547.972650:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:0.0:1784186547.978011:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186547.981287:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915918592 00000100:00100000:3.0:1784186547.981303:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915918592 00000100:00100000:3.0:1784186547.981369:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:3.0:1784186547.981380:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+46:10379:x1870854915918592:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:3.0:1784186547.981653:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+47:10379:x1870854915918592:12345-192.168.201.31@tcp:35:bash.0 Request processed in 274us (3656us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1784186547.981662:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000001:00080000:0.0:1784186548.031801:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967337 is committed 00000004:00080000:0.0:1784186548.031822:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1784186548.031856:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000020:00080000:0.0:1784186548.031896:0:5806:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b9fe5411480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1784186548.031902:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9fc2f6a700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b9fe5411900 00000020:00080000:0.0:1784186548.031905:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9fc2f6a500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b9ffe07f400 00000020:00080000:1.0:1784186548.032022:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1784186548.032135:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1784186548.032405:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937967488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1784186548.032573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186548.032693:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937967488 00000100:00100000:2.0:1784186548.032701:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937967488 00000100:00100000:2.0:1784186548.032772:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784186548.032781:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854937967488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784186548.032808:0:6584:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1784186548.032858:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a5886b2, atime: 0x6a5886b2, ctime: 0x6a5886b2, blocks: 0x1 00010000:00010000:2.0:1784186548.032867:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1958d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784186548.032877:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784186548.032884:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1784186548.032889:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186548.032895:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1958d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.032935:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1958d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.032947:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1958d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.032955:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1958d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.032980:0:6584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784186548.033531:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1870854937967488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 749us (956us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784186548.033540:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:3.0:1784186548.033673:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b9ffe36ed80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1784186548.033680:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937967488:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1784186548.034696:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186548.034710:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1958d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.034725:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d800 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186548.034731:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1958d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.034743:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1958d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.034770:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1958d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.034779:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1958d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.034801:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186548.034803:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186548.034804:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186548.055282:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186548.055350:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915918848 00000100:00100000:0.0:1784186548.055360:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915918848 00000100:00100000:0.0:1784186548.055511:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:3.0:1784186548.055579:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+15:10389:x1870854915918848:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186548.055606:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186548.055625:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19594 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57656d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186548.055867:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1784186548.056012:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19594 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57656d expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.056024:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:3.0:1784186548.056026:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784186548.056029:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19594 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57656d expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.056093:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505a00, rc 0) 00000100:00100000:3.0:1784186548.056157:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+16:10389:x1870854915918848:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 636us (884us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1784186548.056165:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:1.0:1784186548.058591:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.058654:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915918976 00000100:00100000:3.0:1784186548.058662:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915918976 00000100:00100000:3.0:1784186548.058714:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:3.0:1784186548.058725:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+16:10389:x1870854915918976:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:3.0:1784186548.058812:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.058824:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.058834:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.058857:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.058865:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.058871:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059335:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059343:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059347:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784186548.059517:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059531:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059547:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059553:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059557:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186548.059560:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059565:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059575:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186548.059577:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186548.059580:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059584:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059593:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059597:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059601:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059604:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186548.059610:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059614:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059619:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fc7718b00) 00010000:00010000:3.0:1784186548.059620:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186548.059621:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059624:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059646:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059649:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059652:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059655:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186548.059656:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059660:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059664:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186548.059665:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186548.059716:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.059720:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186548.059825:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+16:10389:x1870854915918976:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 1099us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186548.059833:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:0.0:1784186548.061381:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.061538:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915919232 00000100:00100000:3.0:1784186548.061549:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915919232 00000100:00100000:3.0:1784186548.061610:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:3.0:1784186548.061621:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+16:10389:x1870854915919232:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186548.062050:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+17:10389:x1870854915919232:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 429us (675us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1784186548.062058:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:2.0:1784186548.088218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.088262:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915919488 00000100:00100000:3.0:1784186548.088274:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915919488 00000100:00100000:3.0:1784186548.088327:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:3.0:1784186548.088337:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+17:10392:x1870854915919488:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186548.088370:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186548.088392:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576574 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.088882:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.088897:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.088922:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.088939:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.088946:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.088953:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089352:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d195cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089363:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d195cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089371:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d195cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186548.089381:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784186548.089575:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089581:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089585:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089589:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186548.089597:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089602:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089612:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186548.089614:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186548.089616:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089620:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d195be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089628:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089631:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089635:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089637:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186548.089639:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089642:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089646:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fc7718b00) 00010000:00010000:3.0:1784186548.089647:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186548.089652:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089656:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d195c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089796:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576574 expref: 20 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089807:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d195cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576574 expref: 19 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.089812:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186548.089813:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186548.089815:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505a00, rc 0) 00000100:00100000:3.0:1784186548.089937:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+19:10392:x1870854915919488:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1600us (1728us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1784186548.089945:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:1.0:1784186548.092283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186548.092318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186548.092400:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915919744 00000100:00100000:2.0:1784186548.092413:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915919744 00000100:00100000:2.0:1784186548.092583:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:3.0:1784186548.092594:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915919616 00000100:00100000:2.0:1784186548.092594:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+19:10392:x1870854915919744:12345-192.168.201.31@tcp:54:lfs.0 00000100:00100000:3.0:1784186548.092598:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915919616 00000100:00100000:3.0:1784186548.092631:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:3.0:1784186548.092637:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+20:2355:x1870854915919616:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186548.092646:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186548.092655:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.092665:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d195cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576574 expref: 20 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.092669:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.092678:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.092690:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186548.092694:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186548.092716:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.092722:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.092728:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.092734:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186548.092738:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.092745:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.092753:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00000100:00100000:3.0:1784186548.092756:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe273800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+19:2355:x1870854915919616:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 118us (435us total) trans 0 rc 0/0 00010000:00010000:2.0:1784186548.092756:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784186548.092760:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186548.092763:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00010000:00010000:2.0:1784186548.092766:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186548.092799:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+18:10392:x1870854915919744:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 208us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186548.092806:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:0.0:1784186548.094970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186548.095010:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915920000 00000100:00100000:2.0:1784186548.095018:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915920000 00000100:00100000:2.0:1784186548.095073:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:2.0:1784186548.095105:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+18:10392:x1870854915920000:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1784186548.095342:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+19:10392:x1870854915920000:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 240us (424us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1784186548.095357:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:0.0:1784186548.210822:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186548.210960:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915920256 00000100:00100000:2.0:1784186548.210971:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915920256 00000100:00100000:2.0:1784186548.211036:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:2.0:1784186548.211048:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+19:10410:x1870854915920256:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:2.0:1784186548.211075:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186548.211096:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57657b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.211198:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d195e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.211214:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d195e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.211238:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d195e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186548.211249:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784186548.211697:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d195e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57657b expref: 22 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.211719:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d195e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57657b expref: 21 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.211805:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:2.0:1784186548.211808:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1784186548.211810:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d400, rc 0) 00000100:00100000:2.0:1784186548.211888:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10410:x1870854915920256:12345-192.168.201.31@tcp:101:cat.0 Request processed in 842us (1077us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1784186548.211895:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:1.0:1784186548.234993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.235199:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915920384 00000100:00100000:3.0:1784186548.235208:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915920384 00000100:00100000:3.0:1784186548.235343:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:3.0:1784186548.235354:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10411:x1870854915920384:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186548.235381:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186548.235402:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d195f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576582 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.235537:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.235552:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.235564:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186548.235791:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1784186548.235797:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186548.235939:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.235969:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d195f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576582 expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.235987:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576582 expref: 22 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.236008:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186548.236012:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186548.236015:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504600, rc 0) 00000100:00100000:3.0:1784186548.236089:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10411:x1870854915920384:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 735us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186548.236098:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:0.0:1784186548.241389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.241522:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915920768 00000100:00100000:3.0:1784186548.241534:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915920768 00000100:00100000:3.0:1784186548.241596:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:3.0:1784186548.241608:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10411:x1870854915920768:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186548.242067:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+23:10411:x1870854915920768:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 459us (687us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1784186548.242075:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:0.0:1784186548.245982:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.246117:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915920896 00000100:00100000:3.0:1784186548.246131:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915920896 00000100:00100000:3.0:1784186548.246210:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:3.0:1784186548.246221:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+23:10411:x1870854915920896:12345-192.168.201.31@tcp:103:lfs.0 00010000:00010000:3.0:1784186548.246241:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784186548.246291:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19586 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576566 expref: 23 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.246314:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d195e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57657b expref: 22 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.246328:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576527 expref: 21 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.246369:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186548.246406:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186548.246520:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+20:10411:x1870854915920896:12345-192.168.201.31@tcp:103:lfs.0 Request processed in 300us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186548.246529:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:1.0:1784186548.251547:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.251655:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915921024 00000100:00100000:3.0:1784186548.251667:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915921024 00000100:00100000:3.0:1784186548.251731:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:3.0:1784186548.251742:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+20:10411:x1870854915921024:12345-192.168.201.31@tcp:58:lfs.0 00010000:00010000:3.0:1784186548.251891:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19604 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.251909:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19604 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.251933:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19604 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784186548.252637:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784186548.252872:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1784186548.252945:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1784186548.253052:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+20:10411:x1870854915921024:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 1308us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186548.253063:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:2.0:1784186548.274624:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186548.274760:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915921152 00000100:00100000:1.0:1784186548.274771:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915921152 00000100:00100000:1.0:1784186548.274893:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:1.0:1784186548.274918:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+20:10413:x1870854915921152:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1784186548.274941:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186548.274963:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1960b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576589 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275034:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19612 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275048:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275059:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275077:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19619 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275085:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275091:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275404:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275414:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275422:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186548.275501:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784186548.275505:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784186548.275527:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275539:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275548:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19612 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275554:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19612 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275560:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275566:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ede00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186548.275569:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19612 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275577:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19612 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275590:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:1.0:1784186548.275593:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186548.275597:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275603:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275627:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275632:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19619 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275637:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275641:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27edc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186548.275644:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275649:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19619 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275656:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fd1d53800) 00010000:00010000:1.0:1784186548.275658:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186548.275661:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19619 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275665:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19619 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275695:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1960b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576589 expref: 22 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275709:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576589 expref: 21 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186548.275728:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:1.0:1784186548.275730:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784186548.275733:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ed800, rc 0) 00000100:00100000:1.0:1784186548.275917:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10413:x1870854915921152:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 999us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186548.275926:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00010000:00010000:1.0:1784186548.285730:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186548.415292:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937967744:0@lo:400:kworker.0 00000100:00100000:1.0:1784186548.415393:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186548.415469:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937968256:0@lo:400:kworker.0 00000100:00100000:1.0:1784186548.415499:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186548.415531:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784186548.415537:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937967616:0@lo:400:kworker.0 00000100:00100000:1.0:1784186548.415565:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186548.415587:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937968128:0@lo:400:kworker.0 00000100:00100000:1.0:1784186548.415609:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186548.415633:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937968000:0@lo:400:kworker.0 00000100:00100000:1.0:1784186548.415657:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186548.415673:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784186548.415678:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937967872:0@lo:400:kworker.0 00000100:00100000:1.0:1784186548.415699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186548.415728:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937967744 00000100:00100000:1.0:1784186548.415737:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937967744 00000100:00100000:1.0:1784186548.415784:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937968128 00000100:00100000:1.0:1784186548.415794:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937968128 00000100:00100000:1.0:1784186548.415844:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937967872 00000100:00100000:1.0:1784186548.415847:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937967872 00000100:00100000:1.0:1784186548.415865:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784186548.415874:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937967744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186548.416088:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784186548.416099:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937968128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186548.416146:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937968128:12345-0@lo:400:kworker.0 Request processed in 49us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186548.416154:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784186548.416179:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784186548.416186:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937967872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186548.416219:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937967872:12345-0@lo:400:kworker.0 Request processed in 33us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186548.416225:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784186548.416244:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937968256 00000100:00100000:2.0:1784186548.416247:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937968256 00000100:00100000:2.0:1784186548.416288:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937968000 00000100:00100000:2.0:1784186548.416291:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937968000 00000100:00100000:2.0:1784186548.416307:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784186548.416313:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937968256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186548.416344:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937968256:12345-0@lo:400:kworker.0 Request processed in 31us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186548.416360:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784186548.416376:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784186548.416382:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1870854937968000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186548.416413:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1870854937968000:12345-0@lo:400:kworker.0 Request processed in 32us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186548.416420:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784186548.416481:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe271180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937967872:0@lo:400:kworker.0 00000100:00100000:2.0:1784186548.416493:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937968000:0@lo:400:kworker.0 00000100:00100000:2.0:1784186548.416526:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe272a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937968128:0@lo:400:kworker.0 00000100:00100000:2.0:1784186548.416536:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937968256:0@lo:400:kworker.0 00000100:00080000:2.0:1784186548.416576:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784186548.416581:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186548.416593:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937967616 00000100:00100000:2.0:1784186548.416596:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937967616 00000100:00100000:2.0:1784186548.416625:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1784186548.416632:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937967616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186548.416667:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937967616:12345-0@lo:400:kworker.0 Request processed in 36us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186548.416674:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1784186548.416713:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937967616:0@lo:400:kworker.0 00000100:00100000:1.0:1784186548.417041:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937967744:12345-0@lo:400:kworker.0 Request processed in 1166us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186548.417049:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784186548.417115:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937967744:0@lo:400:kworker.0 00000040:00080000:1.0:1784186548.925741:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784186548.925751:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784186548.925796:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1784186548.925802:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784186548.926259:0:11521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffdd39c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937968384:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784186548.926575:0:11521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1784186548.929389:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186548.929424:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937968512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186548.929538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186548.930510:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937968512 00000100:00100000:1.0:1784186548.930521:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937968512 00000100:00100000:1.0:1784186548.930581:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784186548.930592:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937968512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784186548.930635:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186548.930706:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937968512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186548.930714:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784186548.930772:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937968512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784186548.932238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.932377:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915921280 00000100:00100000:3.0:1784186548.932385:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915921280 00000100:00100000:3.0:1784186548.932434:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:3.0:1784186548.932460:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10424:x1870854915921280:12345-192.168.201.31@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1784186548.932531:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10424:x1870854915921280:12345-192.168.201.31@tcp:900:lhsmtool_posix.0 Request processed in 89us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186548.932539:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:1.0:1784186548.933067:0:11521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffdd39c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937968384:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784186548.939199:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.940116:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915921408 00000100:00100000:3.0:1784186548.940129:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915921408 00000100:00100000:3.0:1784186548.940459:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:3.0:1784186548.940472:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10424:x1870854915921408:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784186548.940505:0:5783:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784186548.940623:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10424:x1870854915921408:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 153us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186548.940634:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:2.0:1784186548.945064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.945184:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915921536 00000100:00100000:3.0:1784186548.945196:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915921536 00000100:00100000:3.0:1784186548.945260:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:3.0:1784186548.945270:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10424:x1870854915921536:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784186548.945344:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19627 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945373:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19627 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945388:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19627 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945407:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1962e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945414:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1962e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945430:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1962e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945487:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945497:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945505:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186548.945539:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784186548.945543:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186548.945557:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945569:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19627 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945585:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19627 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945592:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19627 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945599:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505a00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186548.945603:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19627 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945610:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19627 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945632:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:3.0:1784186548.945635:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186548.945640:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19627 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945646:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19627 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945659:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1962e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945665:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1962e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945672:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1962e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945678:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186548.945681:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1962e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945687:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1962e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945695:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9b9fc7718b00) 00010000:00010000:3.0:1784186548.945697:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186548.945700:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1962e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.945706:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d1962e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.946983:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.946991:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19635 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.946998:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.947004:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186548.947007:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.947014:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19635 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.947024:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186548.947027:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186548.947030:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19635 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.947037:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19635 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186548.947124:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10424:x1870854915921536:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 Request processed in 1851us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186548.947132:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:3.0:1784186548.950667:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186548.951593:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915921792 00000100:00100000:0.0:1784186548.951604:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915921792 00000100:00100000:0.0:1784186548.951662:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:0.0:1784186548.951672:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10424:x1870854915921792:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784186548.951693:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186548.951714:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1963c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576590 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.951818:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19643 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.951843:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.951855:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186548.951867:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1784186548.951983:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.951991:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19643 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.951998:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.952013:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186548.952018:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.952025:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19643 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.952038:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:0.0:1784186548.952041:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784186548.952046:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19643 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.952052:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19643 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.952099:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1963c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576590 expref: 23 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.952110:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:0.0:1784186548.952112:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784186548.952116:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1963c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576590 expref: 23 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186548.952124:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128600, rc 0) 00000100:00100000:0.0:1784186548.952212:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10424:x1870854915921792:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 541us (1558us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1784186548.952220:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:3.0:1784186548.955269:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186548.960006:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915921920 00000100:00100000:2.0:1784186548.960021:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915921920 00000100:00100000:2.0:1784186548.960106:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:2.0:1784186548.960114:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10424:x1870854915921920:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784186548.960144:0:5784:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784186548.960260:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10424:x1870854915921920:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 145us (5002us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186548.960269:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:1.0:1784186548.963510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.963577:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915922176 00000100:00100000:3.0:1784186548.963600:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915922176 00000100:00100000:3.0:1784186548.963661:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:3.0:1784186548.963670:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10424:x1870854915922176:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186548.963690:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186548.963693:0:7478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784186548.963919:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d195fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576582 expref: 22 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.963938:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186548.963944:0:7478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186548.963961:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19651 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576597 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784186548.964820:0:7478:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1784186548.965089:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.965105:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.965123:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.965661:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19651 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576597 expref: 24 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.965679:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576597 expref: 23 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.965701:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc7718b00) 00010000:00010000:3.0:1784186548.965704:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186548.965707:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505c00, rc 0) 00000100:00100000:3.0:1784186548.965785:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+23:10424:x1870854915922176:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 2114us (2284us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1784186548.965794:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:3.0:1784186548.972028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186548.972187:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915922432 00000100:00100000:2.0:1784186548.972198:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915922432 00000100:00100000:2.0:1784186548.972256:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:2.0:1784186548.972266:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+23:10424:x1870854915922432:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784186548.972333:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186548.972367:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576597 expref: 23 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.972387:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc7718b00) 00010000:00010000:2.0:1784186548.972412:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186548.972466:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19666 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.972484:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19666 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.972495:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19666 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.972510:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1966d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x218a1d7e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.972524:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1966d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x218a1d7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.972530:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1966d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x218a1d7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973266:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19666 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973277:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19666 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973284:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19666 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973290:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186548.973294:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19666 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973303:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19666 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973315:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:2.0:1784186548.973318:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186548.973322:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19666 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973329:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19666 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973341:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1966d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x218a1d7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973352:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1966d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x218a1d7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973358:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1966d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x218a1d7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973363:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186548.973367:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1966d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x218a1d7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973372:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1966d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x218a1d7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973381:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x218a1d7e (ffff9b9fc5142400) 00010000:00010000:2.0:1784186548.973384:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186548.973386:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1966d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x218a1d7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.973391:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1966d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x218a1d7e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186548.973510:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10424:x1870854915922432:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 1242us (1489us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784186548.973519:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:0.0:1784186548.976217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186548.976293:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915922560 00000100:00100000:2.0:1784186548.976303:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915922560 00000100:00100000:2.0:1784186548.976359:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 74 00000100:00100000:2.0:1784186548.976370:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10424:x1870854915922560:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186548.976393:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186548.976423:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19674 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57659e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.976485:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d1967b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.976500:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d1967b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.976513:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d1967b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.976609:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57659e expref: 24 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.976626:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d1967b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57659e expref: 23 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.976636:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc5142300) 00010000:00010000:2.0:1784186548.976640:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784186548.976644:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766da00, rc 0) 00000100:00100000:2.0:1784186548.976729:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+23:10424:x1870854915922560:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 360us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186548.976736:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 74 00000040:00080000:3.0:1784186548.980778:0:11835:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784186548.980787:0:11835:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186548.981873:0:11835:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784186548.981887:0:11835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784186548.986732:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186548.986855:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915922816 00000100:00100000:3.0:1784186548.986868:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915922816 00000100:00100000:3.0:1784186548.986947:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 75 00000100:00100000:3.0:1784186548.986958:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+23:10424:x1870854915922816:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784186548.987052:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19682 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.987070:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19682 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.987083:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19682 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784186548.987399:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1784186548.987411:0:5784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327708968450ns, next at 328708965462ns, rc = 0 00000004:00010000:3.0:1784186548.987537:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000040580325 reply state 0000000019bd131c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19682 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186548.987555:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784186548.987677:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+25:10424:x1870854915922816:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 719us (963us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1784186548.987685:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 75 00010000:00010000:3.0:1784186548.995304:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19682 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.995323:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19682 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.995332:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19682 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.995339:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186548.995344:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19682 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.995351:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19682 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.995371:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc5142300) 00010000:00010000:3.0:1784186548.995385:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784186548.995390:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19682 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186548.995396:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19682 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186548.999612:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186548.999686:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915922944 00000100:00100000:2.0:1784186548.999697:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915922944 00000100:00100000:2.0:1784186548.999757:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 76 00000100:00100000:2.0:1784186548.999767:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+24:10424:x1870854915922944:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186548.999792:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186548.999836:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19689 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765a5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.999896:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19689 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765a5 expref: 25 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.999907:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19689 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765a5 expref: 25 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186548.999921:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc5142300) 00010000:00010000:2.0:1784186548.999924:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784186548.999927:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766dc00, rc 0) 00000100:00100000:2.0:1784186548.999983:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+25:10424:x1870854915922944:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 218us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186548.999988:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 76 00000100:00100000:2.0:1784186549.012083:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186549.012128:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915923072 00000100:00100000:2.0:1784186549.012138:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915923072 00000100:00100000:2.0:1784186549.012181:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:2.0:1784186549.012190:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1870854915923072:12345-192.168.201.31@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1784186549.012225:0:6584:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:2.0:1784186549.012257:0:6584:0:(genops.c:1406:class_connect()) connect: client efb6eb2c-5579-43c6-be4f-310412860e5b, cookie 0x55bc3e8c99d19690 00002000:00100000:2.0:1784186549.012268:0:6584:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli efb6eb2c-5579-43c6-be4f-310412860e5b/ffff9b9fd10ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784186549.012280:0:6584:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784186549.012554:0:6584:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784186549.012584:0:6584:0:(import.c:65:import_set_state_nolock()) ffff9b9fd10ee800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784186549.012658:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2353:x1870854915923072:12345-192.168.201.31@tcp:8:lhsmtool_posix.0 Request processed in 467us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186549.012679:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:1.0:1784186549.037484:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186549.037536:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915923200 00000100:00100000:3.0:1784186549.037546:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915923200 00000100:00100000:3.0:1784186549.037631:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:3.0:1784186549.037642:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:0:x1870854915923200:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1784186549.037797:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186549.104783:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:0:x1870854915923200:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 67135us (67300us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784186549.104799:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 26 00000001:00100000:3.0:1784186549.104854:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00000001:00080000:3.0:1784186549.104869:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1784186549.110819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186549.111529:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915923456 00000100:00100000:2.0:1784186549.111540:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915923456 00000100:00100000:2.0:1784186549.111656:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:2.0:1784186549.111668:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+25:10424:x1870854915923456:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784186549.111946:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+26:10424:x1870854915923456:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 280us (1138us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1784186549.111956:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00080000:3.0:1784186549.113073:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186549.117009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186549.117270:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915923712 00000100:00100000:2.0:1784186549.117282:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915923712 00000100:00100000:3.0:1784186549.117504:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:3.0:1784186549.117517:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+26:10424:x1870854915923712:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784186549.117638:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+26:10424:x1870854915923712:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 123us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186549.117647:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:0.0:1784186549.120557:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186549.120810:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915923840 00000100:00100000:2.0:1784186549.120829:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915923840 00000100:00100000:2.0:1784186549.120891:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:2.0:1784186549.120912:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+26:10424:x1870854915923840:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186549.120936:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186549.120968:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19697 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765ac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.121050:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1969e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.121066:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1969e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.121080:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1969e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186549.121127:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186549.121159:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1969e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.121192:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19697 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ac expref: 28 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.121215:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1969e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ac expref: 27 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.121224:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc5142300) 00010000:00010000:2.0:1784186549.121228:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784186549.121232:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766ce00, rc 0) 00000100:00100000:2.0:1784186549.121312:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+27:10424:x1870854915923840:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 411us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186549.121321:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:0.0:1784186549.125870:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186549.126201:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915923968 00000100:00100000:3.0:1784186549.126211:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915923968 00000100:00100000:3.0:1784186549.126255:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:3.0:1784186549.126263:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915923968:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186549.126278:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186549.126295:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d64a1cb/0x55bc3e8c99d196a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765b3 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784186549.126317:0:6583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5886b5, blocks: 0x1 00010000:00010000:3.0:1784186549.126332:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1784186549.126342:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186549.126349:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d64a1cb/0x55bc3e8c99d196a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765b3 expref: 6 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.126365:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d64a1cb/0x55bc3e8c99d196a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765b3 expref: 6 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.126375:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504600, rc 0) 00000100:00100000:3.0:1784186549.126428:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2356:x1870854915923968:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 165us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186549.126436:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:3.0:1784186549.140306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186549.140340:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915924224 00000100:00100000:3.0:1784186549.140350:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915924224 00000100:00100000:3.0:1784186549.140397:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:3.0:1784186549.140408:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+27:10424:x1870854915924224:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784186549.140527:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+27:10424:x1870854915924224:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 120us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186549.140535:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:3.0:1784186549.143567:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186549.143605:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915924352 00000100:00100000:3.0:1784186549.143614:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915924352 00000100:00100000:3.0:1784186549.143665:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:3.0:1784186549.143674:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:10424:x1870854915924352:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186549.143690:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186549.143709:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765ba expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.143747:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d64a1cb/0x55bc3e8c99d196a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765b3 expref: 7 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.143758:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186549.143762:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186549.143768:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.144057:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d64a1cb/0x55bc3e8c99d196a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765b3 expref: 7 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.144073:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d64a1cb/0x55bc3e8c99d196a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765b3 expref: 7 pid: 6583 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186549.144088:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd8a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870854937968640:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186549.144180:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5411e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784186549.167200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186549.167293:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd8a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870854937968640:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186549.167329:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.167353:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504800, rc 0) 00000100:00100000:0.0:1784186549.167415:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:10424:x1870854915924352:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 23741us (23858us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186549.167424:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:1.0:1784186549.167573:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915924480 00000100:00100000:1.0:1784186549.167580:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915924480 00010000:00010000:1.0:1784186549.167614:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d64a1cb/0x55bc3e8c99d196a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765b3 expref: 7 pid: 6583 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186549.167650:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:1.0:1784186549.167659:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe55b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2357:x1870854915924480:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186549.167674:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186549.167697:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d64a1cb/0x55bc3e8c99d196a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765b3 expref: 7 pid: 6583 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.167711:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d64a1cb/0x55bc3e8c99d196a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765b3 expref: 7 pid: 6583 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.167735:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d64a1cb/0x55bc3e8c99d196a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765b3 expref: 7 pid: 6583 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.167749:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186549.167753:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186549.167761:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.167771:0:5768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.167806:0:5768:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 6 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186549.167847:0:5768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffdd3b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5768:1870854937968768:192.168.201.31@tcp:105: 00000100:00100000:1.0:1784186549.167900:0:5768:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21f180 going to sleep for 11 seconds 00000100:00100000:1.0:1784186549.171721:0:5768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffdd3b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5768:1870854937968768:192.168.201.31@tcp:105: 00010000:00010000:1.0:1784186549.171759:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186549.171814:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe55b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915924480:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 4154us (4619us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186549.171835:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:2.0:1784186549.180035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186549.180144:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915924608 00000100:00100000:3.0:1784186549.180154:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915924608 00002000:00100000:3.0:1784186549.184372:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b9ffe272a00 x1870854915924608/t0(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:5/0 lens 504/0 e 0 to 0 dl 1784186560 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784186549.184385:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ffe272a00 with x1870854915924608 ext(0->8) 00002000:00010000:3.0:1784186549.184391:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9ffe272a00 00000100:00100000:3.0:1784186549.184427:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:3.0:1784186549.184459:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe272a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2356:x1870854915924608:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1784186549.185202:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe272a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2356:x1870854915924608:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 Request processed in 762us (5173us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1784186549.185213:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00002000:00100000:3.0:1784186549.185224:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9b9ffe272a00 x1870854915924608/t4294967302(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:5/0 lens 504/448 e 0 to 0 dl 1784186560 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784186549.185233:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ffe272a00 with x1870854915924608 ext(0->8) 00002000:00010000:3.0:1784186549.185238:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9ffe272a00 00000100:00100000:2.0:1784186549.190966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186549.191052:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915924736 00000100:00100000:1.0:1784186549.191062:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915924736 00000100:00100000:1.0:1784186549.191119:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:1.0:1784186549.191129:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+27:10424:x1870854915924736:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1784186549.254781:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000020:00080000:0.0:1784186549.254806:0:5806:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1784186549.254830:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1784186549.254848:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1784186549.255082:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784186549.255102:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937968896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1784186549.255737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1784186549.256045:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1784186549.256058:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1784186549.256305:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+13:10424:x1870854915924736:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 Request processed in 65173us (65344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186549.256317:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:3.0:1784186549.256364:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937968896 00000100:00100000:3.0:1784186549.256371:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937968896 00000100:00100000:3.0:1784186549.256420:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784186549.256429:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937968896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1784186549.256624:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784186549.256628:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784186549 00002000:00010000:3.0:1784186549.256630:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784186549.256633:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1784186549 -> 1784186549 00002000:00010000:3.0:1784186549.256635:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784186549.256683:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937968896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 256us (948us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1784186549.256689:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1784186549.256732:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b9ffe83dc00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1784186549.256739:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937968896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1784186549.259749:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186549.260091:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915924864 00000100:00100000:0.0:1784186549.260103:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915924864 00000100:00100000:0.0:1784186549.260161:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:0.0:1784186549.260172:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2357:x1870854915924864:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1784186549.301989:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2357:x1870854915924864:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 Request processed in 41806us (42238us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186549.302004:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000001:00080000:1.0:1784186549.302127:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1784186549.302137:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1784186549.304373:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186549.304834:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915925120 00000100:00100000:3.0:1784186549.304848:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915925120 00000100:00100000:2.0:1784186549.305115:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00100000:2.0:1784186549.305127:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+13:10424:x1870854915925120:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784186549.305286:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186549.305384:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1969e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ac expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.305409:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc5142300) 00010000:00010000:2.0:1784186549.305415:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186549.305534:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d196b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.305570:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d196b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.305581:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d196b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784186549.306731:0:5782:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001e5c545b reply state 0000000087ddc4f1 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d196b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186549.306745:0:5782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186549.306882:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+14:10424:x1870854915925120:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 1752us (2515us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1784186549.306891:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 81 00010000:00010000:3.0:1784186549.311337:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d196b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.311364:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d196b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.311371:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d196b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.311377:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186549.311382:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d196b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.311389:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d196b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.311409:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc5142300) 00010000:00010000:3.0:1784186549.311412:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186549.311417:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d196b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.311424:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d196b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186549.312041:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00010000:00010000:1.0:1784186549.312753:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186549.312772:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915925248 00000100:00100000:1.0:1784186549.312781:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915925248 00000100:00100000:1.0:1784186549.312884:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:1.0:1784186549.312894:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915925248:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784186549.313171:0:6583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1784186549.313175:0:6583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1784186549 -> 1784186548 00002000:00010000:1.0:1784186549.313178:0:6583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784186546 00002000:00010000:1.0:1784186549.313180:0:6583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1784186549 -> 1784186548 00002000:00010000:1.0:1784186549.313196:0:6583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1784186549.313272:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2357:x1870854915925248:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 380us (1240us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784186549.313281:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:2.0:1784186549.323054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186549.323238:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915925504 00000100:00100000:0.0:1784186549.323248:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915925504 00000100:00100000:0.0:1784186549.323419:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:0.0:1784186549.323430:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+13:10424:x1870854915925504:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784186549.323531:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.323548:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d1967b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57659e expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.323557:0:7478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.323606:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d1967b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57659e expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.323621:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d1967b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57659e expref: 13 pid: 5783 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186549.323636:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937969024:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186549.323751:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe23b240 going to sleep for 11 seconds 00000100:00100000:2.0:1784186549.331354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186549.331436:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915925632 00000100:00100000:3.0:1784186549.331464:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915925632 00010000:00010000:3.0:1784186549.331507:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d1967b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57659e expref: 14 pid: 5783 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186549.331553:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:3.0:1784186549.331570:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe270e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+14:2357:x1870854915925632:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186549.331599:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186549.331607:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d1967b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57659e expref: 14 pid: 5783 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.331620:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d1967b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57659e expref: 14 pid: 5783 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.331643:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc5142300) 00010000:00010000:3.0:1784186549.331649:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.331657:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.331674:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.331692:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186549.331750:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe270e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+14:2357:x1870854915925632:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 189us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186549.331758:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 43 00010000:00010000:0.0:1784186549.334085:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d1967b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57659e expref: 13 pid: 5783 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186549.334116:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937969024:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186549.334145:0:7478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.334269:0:7478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.334276:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.334308:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.334676:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.334686:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.334692:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186549.334696:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.334703:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.334719:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc5142300) 00010000:00010000:0.0:1784186549.334722:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784186549.334727:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.334733:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186549.334861:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+12:10424:x1870854915925504:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 Request processed in 11432us (11816us total) trans 0 rc -22/-22 00000100:00100000:0.0:1784186549.334879:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:2.0:1784186549.343329:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186549.343536:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915925760 00000100:00100000:0.0:1784186549.343548:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915925760 00000100:00100000:0.0:1784186549.343626:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:0.0:1784186549.343636:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2357:x1870854915925760:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784186549.343693:0:6581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.343716:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.343725:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1784186549.343729:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784186549.343734:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.343770:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.343784:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 7 pid: 6581 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186549.344131:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870854937969152:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186549.344282:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe23b240 going to sleep for 11 seconds 00000100:00100000:2.0:1784186549.350398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186549.350608:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915925888 00000100:00100000:1.0:1784186549.350618:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915925888 00010000:00010000:1.0:1784186549.350671:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 8 pid: 6581 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186549.350710:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:1.0:1784186549.350720:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2357:x1870854915925888:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186549.350736:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186549.350760:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 8 pid: 6581 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.350775:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 8 pid: 6581 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.350815:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186549.350855:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186549.350861:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.350871:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.350905:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186549.351680:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2357:x1870854915925888:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 958us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186549.351690:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00010000:00010000:0.0:1784186549.355555:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d196ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765ba expref: 7 pid: 6581 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186549.355765:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870854937969152:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186549.355795:0:6581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.356107:0:6581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.356117:0:6581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.356280:0:6581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.356290:0:6581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.356299:0:6581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.356306:0:6581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129c00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186549.356310:0:6581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.356779:0:6581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.356883:0:6581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.357044:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005055fbda/0x55bc3e8c99d196c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186549.357544:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915925760:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 Request processed in 13903us (14227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186549.357556:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:2.0:1784186549.369221:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186549.369306:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915926144 00000100:00100000:3.0:1784186549.369316:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915926144 00000100:00100000:3.0:1784186549.369388:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 83 00000100:00100000:3.0:1784186549.369399:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+12:10424:x1870854915926144:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784186549.369506:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d196c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.369524:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d196c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.369549:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d196c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.370105:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.370121:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19689 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765a5 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.370130:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.370168:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19689 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765a5 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186549.370183:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19689 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765a5 expref: 13 pid: 5783 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186549.370200:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd8aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5784:1870854937969280:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186549.370394:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5411d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784186549.381143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186549.381567:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915926272 00000100:00100000:0.0:1784186549.381578:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915926272 00010000:00010000:0.0:1784186549.381624:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19689 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765a5 expref: 14 pid: 5783 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186549.381678:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:0.0:1784186549.381688:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+14:2356:x1870854915926272:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186549.381704:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186549.381712:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19689 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765a5 expref: 14 pid: 5783 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.381726:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19689 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765a5 expref: 14 pid: 5783 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.381753:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc5142300) 00010000:00010000:0.0:1784186549.381758:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.381767:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.381775:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.381815:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186549.381901:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5497b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+14:2356:x1870854915926272:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 207us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186549.381910:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 45 00010000:00010000:3.0:1784186549.386426:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19689 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765a5 expref: 13 pid: 5783 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186549.386745:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd8aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5784:1870854937969280:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186549.386778:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.387087:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.387096:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784186549.388047:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1784186549.388388:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1784186549.388538:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1784186549.389075:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e13480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5784:1870854937969408:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784186549.389775:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186549.390007:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec6806e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784186549.390120:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937969408 00000100:00100000:3.0:1784186549.390134:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937969408 00000100:00100000:3.0:1784186549.390301:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784186549.390312:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5784:x1870854937969408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1784186549.390433:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5784:x1870854937969408:12345-0@lo:1000:mdt00_002.0 Request processed in 123us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186549.390467:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784186549.390551:0:5784:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1784186549.390557:0:5784:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b9ffe83dc00, transno 4294967303 00000100:00100000:2.0:1784186549.390591:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e13480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5784:1870854937969408:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1784186549.391200:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1784186549.391282:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e13480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5784:1870854937969536:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784186549.391331:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186549.393294:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec6806f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784186549.393389:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937969536 00000100:00100000:1.0:1784186549.393400:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937969536 00000100:00100000:1.0:1784186549.393477:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784186549.393487:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5784:x1870854937969536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784186549.394201:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5784:x1870854937969536:12345-0@lo:1000:mdt00_002.0 Request processed in 712us (2865us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1784186549.394210:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784186549.395269:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e13480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5784:1870854937969536:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1784186549.395386:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.395398:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.395405:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.395411:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186549.395415:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.395421:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.395437:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fc5142300) 00010000:00010000:2.0:1784186549.395790:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784186549.395868:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.395890:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d196cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396058:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19604 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396065:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19604 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396071:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19604 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396076:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505e00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186549.396079:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19604 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396085:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19604 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396095:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:2.0:1784186549.396097:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784186549.396101:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19604 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396107:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19604 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396126:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396140:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576589 expref: 16 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396223:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396267:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576589 expref: 16 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186549.396283:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576589 expref: 16 pid: 7478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186549.396299:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5784:1870854937969664:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186549.396541:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec6806f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186549.402685:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186549.403883:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915926400 00000100:00100000:1.0:1784186549.403895:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915926400 00010000:00010000:1.0:1784186549.404014:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576589 expref: 17 pid: 7478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186549.404143:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5784:1870854937969664:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186549.404234:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:1.0:1784186549.404245:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+17:2356:x1870854915926400:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186549.404260:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186549.404268:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576589 expref: 17 pid: 7478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.404281:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576589 expref: 17 pid: 7478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.404332:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576589 expref: 17 pid: 7478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.404347:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:1.0:1784186549.404368:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.404378:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.404386:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.404404:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784186549.404730:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.404742:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.404748:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.404761:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.404767:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.404773:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.404779:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186549.404783:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.404789:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186549.404880:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+16:2356:x1870854915926400:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 635us (2204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186549.404889:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 46 00010000:00010000:0.0:1784186549.405838:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:0.0:1784186549.405841:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186549.405846:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.405853:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d196d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.405873:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d196c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.405879:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d196c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.405885:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d196c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.405890:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505a00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186549.405904:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d196c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.405911:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d196c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.405918:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:0.0:1784186549.405920:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784186549.405922:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d196c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.405936:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d196c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186549.406541:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+15:10424:x1870854915926144:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 37138us (37326us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1784186549.406554:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 83 00000020:00080000:0.0:1784186549.406570:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784186549.406838:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784186549.406843:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186549.406904:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784186549.406911:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784186549.411677:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186549.412118:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915926656 00000100:00100000:0.0:1784186549.412131:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915926656 00000100:00100000:0.0:1784186549.412303:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:0.0:1784186549.412326:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+15:10424:x1870854915926656:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784186549.413873:0:5786:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784186549.414252:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1784186549.414311:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.414650:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.414663:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.414674:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.414681:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.414687:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186549.414757:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784186549.414913:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+17:10424:x1870854915926656:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 2596us (3806us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1784186549.414923:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000020:00080000:0.0:1784186549.414994:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784186549.417885:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186549.418023:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.418034:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129c00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186549.418039:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.418047:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.418069:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9b9fd011ac00) 00010000:00010000:1.0:1784186549.418092:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784186549.418097:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196dd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.418103:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d196dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186549.418130:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186549.418132:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186549.418134:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186550.334477:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186550.610807:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186550.610849:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186550.610882:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186550.610906:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186550.610927:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186550.610937:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915927040 00000100:00100000:2.0:1784186550.610947:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915927168 00000100:00100000:1.0:1784186550.610947:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915927040 00000100:00100000:2.0:1784186550.610950:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915927168 00000100:00100000:2.0:1784186550.610998:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 74 00000100:00100000:2.0:1784186550.611008:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915927168:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186550.611030:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915926784 00000100:00100000:3.0:1784186550.611035:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915926784 00000100:00100000:3.0:1784186550.611062:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 285 00000100:00100000:3.0:1784186550.611068:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915926784:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186550.611079:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915927168:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 73us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186550.611086:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 74 00000100:00100000:3.0:1784186550.611092:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915926784:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186550.611098:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 285 00000100:00100000:2.0:1784186550.611115:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 75 00000100:00100000:2.0:1784186550.611120:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915927040:12345-192.168.201.31@tcp:400:kworker.0 00000100:00080000:3.0:1784186550.611128:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784186550.611157:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915927040:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186550.611164:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 75 00000100:00100000:0.0:1784186550.611218:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915927296 00000100:00100000:0.0:1784186550.611222:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915927296 00000100:00100000:0.0:1784186550.611255:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915926912 00000100:00080000:3.0:1784186550.611256:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186550.611259:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915926912 00000100:00100000:0.0:1784186550.611282:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 132 00000100:00100000:0.0:1784186550.611289:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915927296:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186550.611291:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 133 00000100:00100000:3.0:1784186550.611297:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+17:2354:x1870854915926912:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186550.611318:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915927296:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 30us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186550.611321:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+17:2354:x1870854915926912:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186550.611325:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 132 00000100:00100000:3.0:1784186550.611328:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 133 00000040:00080000:3.0:1784186550.909472:0:11888:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784186550.909482:0:11888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186550.909520:0:11888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784186550.909532:0:11888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784186551.068596:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186551.068741:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915927552 00000100:00100000:0.0:1784186551.068752:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915927552 00000100:00100000:0.0:1784186551.068830:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 84 00000100:00100000:0.0:1784186551.068840:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+17:10443:x1870854915927552:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186551.068861:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186551.068883:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d196e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765c1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.069162:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d196eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.069178:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d196eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.069190:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d196eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186551.069214:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1784186551.069388:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d196e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c1 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.069406:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d196eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c1 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.069415:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:0.0:1784186551.069417:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784186551.069421:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129a00, rc 0) 00000100:00100000:0.0:1784186551.069516:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+19:10443:x1870854915927552:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 676us (929us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1784186551.069525:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 84 00000100:00080000:3.0:1784186551.070148:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186551.074487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186551.074631:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915927680 00000100:00100000:0.0:1784186551.074643:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915927680 00000100:00100000:0.0:1784186551.074711:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 85 00000100:00100000:0.0:1784186551.074724:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+19:10443:x1870854915927680:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:0.0:1784186551.074819:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d196f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.074837:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d196f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.074850:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d196f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.074868:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19700 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.074893:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.074901:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075248:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075258:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075265:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784186551.075310:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075323:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d196f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075330:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d196f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075337:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d196f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075343:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.075348:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d196f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075355:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d196f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075374:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:0.0:1784186551.075376:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.075381:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d196f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075387:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d196f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075400:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075406:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19700 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075412:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075417:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.075420:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075426:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19700 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075432:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fd011aa00) 00010000:00010000:0.0:1784186551.075434:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.075437:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19700 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075489:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19700 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075515:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075521:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19707 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075527:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075531:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.075534:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075541:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075548:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011a200) 00010000:00010000:0.0:1784186551.075551:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.075554:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19707 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.075559:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186551.075643:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+19:10443:x1870854915927680:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 919us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186551.075652:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 85 00000100:00100000:2.0:1784186551.165215:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186551.169715:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915927936 00000100:00100000:0.0:1784186551.169733:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915927936 00000100:00100000:0.0:1784186551.169821:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:0.0:1784186551.169848:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+19:10446:x1870854915927936:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186551.169879:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186551.169904:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1970e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765c8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.169978:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19715 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.169993:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19715 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170005:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19715 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170020:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1971c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170028:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1971c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170034:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1971c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170333:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19723 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170342:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170495:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186551.170518:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1784186551.170608:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19715 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170616:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19715 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170623:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19715 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170630:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.170633:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19715 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170641:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19715 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170652:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:0.0:1784186551.170656:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.170660:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19715 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170667:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19715 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170676:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1971c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170682:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1971c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170697:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1971c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170702:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.170705:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1971c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170710:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1971c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170717:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fd011a200) 00010000:00010000:0.0:1784186551.170720:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.170723:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1971c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170729:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1971c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170772:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1970e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c8 expref: 22 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170798:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c8 expref: 21 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.170805:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:0.0:1784186551.170807:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784186551.170810:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128600, rc 0) 00000100:00100000:0.0:1784186551.170950:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10446:x1870854915927936:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1104us (5743us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1784186551.170967:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:3.0:1784186551.173765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186551.173837:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915928064 00000100:00100000:1.0:1784186551.173847:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915928064 00000100:00100000:1.0:1784186551.173916:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 87 00000100:00100000:1.0:1784186551.173926:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10446:x1870854915928064:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:1.0:1784186551.173987:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19731 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.174004:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.174015:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.174040:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.174047:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19731 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.174053:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.174071:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186551.174075:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.174083:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.174094:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:1.0:1784186551.174097:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784186551.174101:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19731 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.174107:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19731 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186551.177059:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10446:x1870854915928064:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 3123us (3294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186551.177074:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 87 00000100:00100000:3.0:1784186551.180249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.180309:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915928320 00000100:00100000:2.0:1784186551.180319:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915928320 00000100:00100000:2.0:1784186551.180371:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:2.0:1784186551.180379:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10446:x1870854915928320:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1784186551.180645:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10446:x1870854915928320:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 265us (410us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1784186551.180653:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:0.0:1784186551.197261:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186551.197316:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915928576 00000100:00100000:3.0:1784186551.197328:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915928576 00000100:00100000:3.0:1784186551.198004:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 88 00000100:00100000:3.0:1784186551.198015:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+22:9966:x1870854915928576:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1784186551.198041:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186551.198059:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19738 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765cf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.198149:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.198164:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19723 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c8 expref: 23 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.198172:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.198206:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c8 expref: 23 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.198216:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19723 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c8 expref: 23 pid: 5783 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186551.198242:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd8a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937969792:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186551.198321:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc93a5180 going to sleep for 11 seconds 00000100:00100000:0.0:1784186551.200532:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186551.200581:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915928704 00000100:00100000:1.0:1784186551.200590:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915928704 00010000:00010000:1.0:1784186551.200629:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19723 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c8 expref: 24 pid: 5783 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186551.200669:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:1.0:1784186551.200678:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+24:2357:x1870854915928704:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186551.200693:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186551.200700:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19723 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c8 expref: 24 pid: 5783 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.200732:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19723 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c8 expref: 24 pid: 5783 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.200756:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:1.0:1784186551.200762:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.200779:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.200801:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.200820:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186551.200863:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+24:2357:x1870854915928704:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 186us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186551.200871:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00010000:00010000:3.0:1784186551.201156:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19723 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c8 expref: 23 pid: 5783 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186551.201172:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd8a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937969792:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186551.201192:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.201200:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.201206:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186551.201224:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1784186551.202056:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19738 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765cf expref: 24 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.202070:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765cf expref: 23 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.202077:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:3.0:1784186551.202079:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784186551.202080:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505a00, rc 0) 00000100:00100000:3.0:1784186551.202200:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+23:9966:x1870854915928576:12345-192.168.201.31@tcp:101:bash.0 Request processed in 4186us (4950us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1784186551.202217:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 88 00000100:00100000:1.0:1784186551.204046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.204119:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915928960 00000100:00100000:2.0:1784186551.204131:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915928960 00000100:00100000:2.0:1784186551.204209:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 89 00000100:00100000:2.0:1784186551.204218:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+23:9966:x1870854915928960:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:2.0:1784186551.204483:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1974d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.204500:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1974d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.204511:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1974d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784186551.204558:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1784186551.204590:0:5782:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056b6bca2 reply state 000000004e3a571f transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1974d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186551.204596:0:5782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1784186551.204630:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1784186551.204727:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+27:9966:x1870854915928960:12345-192.168.201.31@tcp:36:bash.0 Request processed in 506us (684us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1784186551.204734:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 89 00000020:00080000:2.0:1784186551.204739:0:5782:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1784186551.207206:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1974d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.207223:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1974d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.207231:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1974d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.207238:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186551.207243:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1974d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186551.207258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00010000:00010000:1.0:1784186551.207264:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1974d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.207280:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:1.0:1784186551.207283:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186551.207288:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1974d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.207294:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1974d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186551.207326:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915929088 00000100:00100000:1.0:1784186551.207334:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915929088 00000100:00100000:1.0:1784186551.207385:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 90 00000100:00100000:1.0:1784186551.207395:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+26:9966:x1870854915929088:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1784186551.207415:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186551.207431:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19754 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765d6 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.207519:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765d6 expref: 27 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.207532:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19754 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765d6 expref: 27 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.207547:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:1.0:1784186551.207549:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186551.207552:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ec400, rc 0) 00000100:00100000:1.0:1784186551.207604:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+27:9966:x1870854915929088:12345-192.168.201.31@tcp:101:bash.0 Request processed in 211us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186551.207612:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 90 00000100:00100000:0.0:1784186551.214301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186551.214363:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915929216 00000100:00100000:1.0:1784186551.214373:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915929216 00000100:00100000:1.0:1784186551.214543:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:1.0:1784186551.214555:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdbc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:9966:x1870854915929216:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1784186551.214572:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186551.214592:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ec84127/0x55bc3e8c99d1975b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765dd expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784186551.214619:0:6583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a5886b4, atime: 0x6a5886b2, ctime: 0x6a5886b4, blocks: 0xb 00010000:00010000:1.0:1784186551.214640:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1784186551.214645:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186551.214654:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ec84127/0x55bc3e8c99d1975b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765dd expref: 7 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.214671:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ec84127/0x55bc3e8c99d1975b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765dd expref: 7 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.214684:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ece00, rc 0) 00000100:00100000:1.0:1784186551.214734:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdbc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:9966:x1870854915929216:12345-192.168.201.31@tcp:101:bash.0 Request processed in 182us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186551.214741:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00080000:3.0:1784186551.214990:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784186551.219085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186551.219151:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915929344 00000100:00100000:3.0:1784186551.219161:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915929344 00002000:00010000:3.0:1784186551.219206:0:6587:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1784186551.219211:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ffe83e300 with x1870854915929344 ext(0->18446744073709551615) 00002000:00010000:3.0:1784186551.219493:0:6587:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9ffe83e300. 00000100:00100000:3.0:1784186551.219580:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:3.0:1784186551.219591:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2356:x1870854915929344:12345-192.168.201.31@tcp:10:bash.0 00002000:00010000:3.0:1784186551.219913:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1784186551.219917:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1784186548 -> 1784186551 00002000:00010000:3.0:1784186551.219920:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1784186546 -> 1784186546 00002000:00010000:3.0:1784186551.219922:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1784186548 -> 1784186551 00002000:00010000:3.0:1784186551.219924:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1784186551.219990:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2356:x1870854915929344:12345-192.168.201.31@tcp:10:bash.0 Request processed in 400us (914us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1784186551.219999:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00002000:00010000:3.0:1784186551.220003:0:6587:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1784186551.220005:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ffe83e300 with x1870854915929344 ext(0->18446744073709551615) 00002000:00010000:3.0:1784186551.220010:0:6587:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9ffe83e300. 00000100:00100000:0.0:1784186551.277753:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186551.277889:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915929472 00000100:00100000:1.0:1784186551.277900:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915929472 00000100:00100000:1.0:1784186551.278033:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 91 00000100:00100000:1.0:1784186551.278046:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+27:10460:x1870854915929472:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:1.0:1784186551.278137:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19762 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.278159:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.278172:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.278188:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19769 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.278194:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.278201:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279051:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279064:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279073:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784186551.279117:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279129:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279135:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19762 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279142:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19762 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279148:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27eca00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.279152:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19762 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279167:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19762 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279181:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:0.0:1784186551.279185:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.279190:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19762 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279196:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19762 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279211:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279216:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19769 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279222:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279227:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.279230:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279236:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19769 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279244:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fd1d53700) 00010000:00010000:0.0:1784186551.279246:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.279248:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19769 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279263:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed800/0x55bc3e8c99d19769 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279278:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279284:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19770 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279290:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279295:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031e00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.279299:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279303:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19770 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279310:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:0.0:1784186551.279312:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.279314:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19770 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.279319:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19770 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186551.279651:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+27:10460:x1870854915929472:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 1603us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186551.279662:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 91 00000100:00100000:0.0:1784186551.322779:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186551.322897:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915929728 00000100:00100000:3.0:1784186551.322908:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915929728 00000100:00100000:3.0:1784186551.322972:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00100000:3.0:1784186551.322983:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+27:10463:x1870854915929728:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186551.323003:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186551.323036:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19777 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765e4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323107:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d1977e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323122:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d1977e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323135:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d1977e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323152:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323159:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323166:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323610:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1978c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323620:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1978c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323627:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1978c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186551.323637:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784186551.323729:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d1977e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323747:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d1977e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323753:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d1977e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323760:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505e00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186551.323764:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d1977e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323772:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d1977e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323795:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186551.323799:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186551.323803:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d1977e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323810:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d1977e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323822:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323828:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19785 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323833:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323838:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186551.323847:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323853:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19785 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323860:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fc7718300) 00010000:00010000:3.0:1784186551.323863:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186551.323865:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19785 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323870:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19785 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323911:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19777 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765e4 expref: 30 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323924:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1978c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765e4 expref: 29 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.323931:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:3.0:1784186551.323933:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784186551.323936:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504800, rc 0) 00000100:00100000:3.0:1784186551.324106:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+29:10463:x1870854915929728:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1124us (1335us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1784186551.324115:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00100000:1.0:1784186551.327273:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.327424:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915929856 00000100:00100000:2.0:1784186551.327433:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915929856 00000100:00100000:2.0:1784186551.327539:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 93 00000100:00100000:2.0:1784186551.327548:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+29:10463:x1870854915929856:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:2.0:1784186551.327612:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.327629:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765cf expref: 29 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.327638:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.327671:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765cf expref: 29 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.327685:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765cf expref: 29 pid: 5783 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186551.327700:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e12300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937969920:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186551.328016:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec6806b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784186551.333376:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e12300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937969920:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186551.333405:0:5782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186551.335075:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186551.335851:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915930112 00000100:00100000:0.0:1784186551.335862:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915930112 00000100:00100000:0.0:1784186551.336034:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:0.0:1784186551.336046:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+30:5570:x1870854915930112:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784186551.336436:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+31:5570:x1870854915930112:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 390us (1365us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1784186551.336475:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:3.0:1784186551.338561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186551.338672:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915930240 00000100:00100000:1.0:1784186551.338681:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915930240 00010000:00010000:1.0:1784186551.338719:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765cf expref: 31 pid: 5783 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186551.338771:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:1.0:1784186551.338782:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+31:2357:x1870854915930240:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186551.338811:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186551.338834:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765cf expref: 31 pid: 5783 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.338847:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765cf expref: 31 pid: 5783 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.338882:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d1973f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765cf expref: 31 pid: 5783 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.338900:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:1.0:1784186551.338906:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.338915:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.338923:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.338952:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186551.339006:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+30:2357:x1870854915930240:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 226us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186551.339014:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 48 00010000:00010000:1.0:1784186551.339050:0:5782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.339057:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.339094:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.339110:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.339117:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.339123:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186551.339127:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.339136:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.339145:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:1.0:1784186551.339148:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784186551.339151:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.339156:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1979a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186551.339196:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+29:10463:x1870854915929856:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 11649us (11932us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186551.339204:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 93 00000100:00100000:3.0:1784186551.341970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.342067:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915930496 00000100:00100000:2.0:1784186551.342077:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915930496 00000100:00100000:2.0:1784186551.342136:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:2.0:1784186551.342147:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+29:10463:x1870854915930496:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1784186551.342407:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+30:10463:x1870854915930496:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 261us (446us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1784186551.342415:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00010000:00010000:1.0:1784186551.357613:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186551.427363:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.427478:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915930752 00000100:00100000:2.0:1784186551.427491:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915930752 00000100:00100000:2.0:1784186551.427556:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00100000:2.0:1784186551.427565:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+30:10474:x1870854915930752:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:2.0:1784186551.427597:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186551.427628:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d197a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765eb expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.427698:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.427723:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.427735:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.427748:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.427755:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.427794:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428123:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d197b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428132:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d197b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428140:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d197b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186551.428151:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1784186551.428246:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428255:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428261:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428267:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186551.428271:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428276:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428288:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:2.0:1784186551.428291:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186551.428304:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428311:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428324:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428330:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428336:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428341:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766cc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186551.428344:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428350:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428357:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fc5142400) 00010000:00010000:2.0:1784186551.428359:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186551.428361:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428365:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428402:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d197a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765eb expref: 33 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428428:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d197b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765eb expref: 32 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.428436:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:2.0:1784186551.428438:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186551.428510:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d200, rc 0) 00000100:00100000:2.0:1784186551.428588:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+32:10474:x1870854915930752:12345-192.168.201.31@tcp:101:cat.0 Request processed in 1023us (1249us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1784186551.428596:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00100000:3.0:1784186551.441731:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.442711:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915931008 00000100:00100000:2.0:1784186551.442723:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915931008 00000100:00100000:2.0:1784186551.442806:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:2.0:1784186551.442816:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+32:10474:x1870854915931008:12345-192.168.201.31@tcp:35:cat.0 00000100:00100000:2.0:1784186551.443092:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+33:10474:x1870854915931008:12345-192.168.201.31@tcp:35:cat.0 Request processed in 276us (1371us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1784186551.443100:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:1.0:1784186551.484985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186551.485085:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915931264 00000100:00100000:0.0:1784186551.485095:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915931264 00000100:00100000:0.0:1784186551.485154:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 95 00000100:00100000:0.0:1784186551.485165:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+33:10475:x1870854915931264:12345-192.168.201.31@tcp:36:rm.0 00010000:00010000:0.0:1784186551.485258:0:7478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784186551.485290:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d197b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765eb expref: 33 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.485316:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1978c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765e4 expref: 32 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.485330:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19754 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765d6 expref: 31 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.485341:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011aa00) 00010000:00010000:0.0:1784186551.485356:0:7478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784186551.485382:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d197c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.485396:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d197c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.485413:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d197c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.485429:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d197cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.485436:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d197cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.485509:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d197cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.486545:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d197d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.486558:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d197d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.486567:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d197d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784186551.487976:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1784186551.487987:0:7478:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330209544832ns, next at 331209542515ns, rc = 0 00010000:00010000:0.0:1784186551.488059:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d197d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488072:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d197d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488082:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d197d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488101:0:7478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d197d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488107:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d197d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488114:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d197d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488867:0:7478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784186551.488898:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d197d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488904:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d197d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488910:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d197d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488916:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031e00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.488921:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d197d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488928:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d197d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488944:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011ad00) 00010000:00010000:0.0:1784186551.488947:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784186551.488952:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d197d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488971:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d197d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.488997:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d197c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.489004:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d197c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.489010:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d197c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.489015:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.489019:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d197c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.489024:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d197c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.489032:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:0.0:1784186551.489034:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.489037:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d197c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.489041:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d197c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784186551.489052:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002ffd629b reply state 000000005102c091 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d197cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186551.489061:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784186551.489298:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+32:10475:x1870854915931264:12345-192.168.201.31@tcp:36:rm.0 Request processed in 4128us (4316us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1784186551.489307:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 95 00010000:00010000:2.0:1784186551.491058:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186551.491070:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d197d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.491081:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186551.491085:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d197d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.491094:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d197d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.491708:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9b9fd011ad00) 00010000:00010000:2.0:1784186551.491712:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784186551.491718:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d197d9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.491724:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d197d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.491746:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186551.491748:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186551.491749:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186551.496021:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d197cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.496041:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d197cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.496048:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d197cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.496054:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031a00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186551.496059:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d197cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.496066:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d197cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.496087:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fd011a200) 00010000:00010000:3.0:1784186551.496090:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186551.496095:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d197cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.496101:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d197cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186551.554304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.554496:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915931520 00000100:00100000:2.0:1784186551.554507:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915931520 00000100:00100000:2.0:1784186551.554570:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 96 00000100:00100000:2.0:1784186551.554592:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+31:10481:x1870854915931520:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1784186551.554619:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186551.554645:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d197e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765f2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.554830:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.554846:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.554858:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.554872:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.554894:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.554907:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784186551.555503:0:5784:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1784186551.555667:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d197f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.559922:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d197f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.559954:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d197f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.560166:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.560198:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.560205:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.560212:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766cc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186551.560217:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.560224:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.560238:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186551.560241:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186551.560245:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.560251:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d197e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784186551.560274:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6c64916 reply state 000000007c8f4316 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186551.560284:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784186551.560337:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d197e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f2 expref: 34 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.560355:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d197f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f2 expref: 33 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.560374:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186551.560376:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186551.560379:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d800, rc 0) 00000100:00100000:3.0:1784186551.560521:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+34:10481:x1870854915931520:12345-192.168.201.31@tcp:101:bash.0 Request processed in 5931us (6228us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1784186551.560531:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 96 00010000:00010000:3.0:1784186551.564377:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.564397:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.564405:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.564413:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186551.564419:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.564438:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.564497:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fc5142400) 00010000:00010000:3.0:1784186551.564500:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186551.564506:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.564512:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d197ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186551.575632:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.575895:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915931648 00000100:00100000:2.0:1784186551.575906:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915931648 00000100:00100000:2.0:1784186551.575973:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:2.0:1784186551.575983:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2355:x1870854915931648:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1784186551.576002:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186551.576023:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061f7024c/0x55bc3e8c99d19803 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5765f9 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784186551.576050:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784186551.576070:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:2.0:1784186551.576075:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186551.576084:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061f7024c/0x55bc3e8c99d19803 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f9 expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.576124:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061f7024c/0x55bc3e8c99d19803 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f9 expref: 8 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.576138:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c600, rc 0) 00000100:00100000:2.0:1784186551.576203:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2355:x1870854915931648:12345-192.168.201.31@tcp:101:bash.0 Request processed in 221us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186551.576210:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:1.0:1784186551.583909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.584134:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915931776 00000100:00100000:2.0:1784186551.584144:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915931776 00000100:00100000:2.0:1784186551.584204:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:2.0:1784186551.584214:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+8:10481:x1870854915931776:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1784186551.584230:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186551.584248:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576600 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.584280:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061f7024c/0x55bc3e8c99d19803 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f9 expref: 9 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.584289:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186551.584293:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186551.584299:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 9 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.584333:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061f7024c/0x55bc3e8c99d19803 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f9 expref: 9 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.584352:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061f7024c/0x55bc3e8c99d19803 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f9 expref: 9 pid: 6584 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186551.584366:0:6583:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6583:1870854937970048:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186551.584512:0:6583:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec6806600 going to sleep for 11 seconds 00000100:00100000:2.0:1784186551.588195:0:6583:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6583:1870854937970048:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186551.588246:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 9 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.588270:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766ce00, rc 0) 00000100:00100000:2.0:1784186551.588345:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+9:10481:x1870854915931776:12345-192.168.201.31@tcp:101:bash.0 Request processed in 4131us (4447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186551.588355:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:3.0:1784186551.588720:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186551.588883:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915931904 00000100:00100000:0.0:1784186551.588891:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915931904 00010000:00010000:0.0:1784186551.588925:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061f7024c/0x55bc3e8c99d19803 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f9 expref: 9 pid: 6584 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186551.588964:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:0.0:1784186551.588974:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe55b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2357:x1870854915931904:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186551.588989:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186551.589017:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061f7024c/0x55bc3e8c99d19803 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f9 expref: 9 pid: 6584 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.589031:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061f7024c/0x55bc3e8c99d19803 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f9 expref: 9 pid: 6584 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.589057:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061f7024c/0x55bc3e8c99d19803 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f9 expref: 9 pid: 6584 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.589074:0:5767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186551.589079:0:5767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186551.589089:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 8 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.589099:0:5767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 8 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.589170:0:5767:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 8 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186551.589184:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5767:1870854937970176:192.168.201.31@tcp:105: 00000100:00100000:0.0:1784186551.589256:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe23b300 going to sleep for 11 seconds 00000100:00100000:0.0:1784186551.592331:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5767:1870854937970176:192.168.201.31@tcp:105: 00010000:00010000:0.0:1784186551.592371:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186551.592425:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe55b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2357:x1870854915931904:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 3451us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186551.592436:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:3.0:1784186551.593378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.593524:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915932160 00000100:00100000:2.0:1784186551.593532:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915932160 00000100:00100000:2.0:1784186551.593578:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:2.0:1784186551.593588:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+33:10481:x1870854915932160:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:2.0:1784186551.593958:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+34:10481:x1870854915932160:12345-192.168.201.31@tcp:35:bash.0 Request processed in 371us (584us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1784186551.593967:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:1.0:1784186551.642945:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186551.642997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186551.643136:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915932416 00000100:00100000:3.0:1784186551.643146:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915932416 00000100:00100000:3.0:1784186551.643209:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:3.0:1784186551.643218:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2354:x1870854915932416:12345-192.168.201.31@tcp:16:kworker.0 00000100:00100000:3.0:1784186551.643342:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2354:x1870854915932416:12345-192.168.201.31@tcp:16:kworker.0 Request processed in 124us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186551.643350:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:2.0:1784186551.644951:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915932288 00000100:00100000:2.0:1784186551.644963:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915932288 00002000:00100000:2.0:1784186551.645015:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b9ffdd3b480 x1870854915932288/t0(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:7/0 lens 504/0 e 0 to 0 dl 1784186562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186551.645048:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ffdd3b480 with x1870854915932288 ext(0->8) 00002000:00010000:2.0:1784186551.645054:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b9ffdd3b480 00000100:00100000:2.0:1784186551.645096:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:2.0:1784186551.645106:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2354:x1870854915932288:12345-192.168.201.31@tcp:4:bash.0 00000100:00100000:2.0:1784186551.645649:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+10:2354:x1870854915932288:12345-192.168.201.31@tcp:4:bash.0 Request processed in 543us (2712us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784186551.645658:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00002000:00100000:2.0:1784186551.645666:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9b9ffdd3b480 x1870854915932288/t4294967302(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:7/0 lens 504/448 e 0 to 0 dl 1784186562 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186551.645674:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ffdd3b480 with x1870854915932288 ext(0->8) 00002000:00010000:2.0:1784186551.645678:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b9ffdd3b480 00000100:00100000:1.0:1784186551.807728:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186551.807855:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915932544 00000100:00100000:3.0:1784186551.807865:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915932544 00000100:00100000:3.0:1784186551.807934:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 97 00000100:00100000:3.0:1784186551.807945:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+34:10497:x1870854915932544:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186551.807971:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186551.807990:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19811 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576607 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.808060:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.808073:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.808084:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186551.808143:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1784186551.808159:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186551.808186:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.808211:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19811 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576607 expref: 36 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.808230:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576607 expref: 35 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.808251:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186551.808254:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186551.808258:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504400, rc 0) 00000100:00100000:3.0:1784186551.808320:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+35:10497:x1870854915932544:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 378us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186551.808328:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 97 00000100:00100000:1.0:1784186551.822240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186551.822339:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915932800 00000100:00100000:3.0:1784186551.822350:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915932800 00000100:00100000:3.0:1784186551.822413:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 98 00000100:00100000:3.0:1784186551.822425:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+35:10497:x1870854915932800:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186551.822467:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186551.822490:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d1981f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57660e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.823287:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.823302:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.823332:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186551.823345:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784186551.823512:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d1981f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57660e expref: 38 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.823533:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57660e expref: 37 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.823542:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186551.823545:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186551.823548:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505e00, rc 0) 00000100:00100000:3.0:1784186551.823665:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+37:10497:x1870854915932800:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1242us (1434us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1784186551.823672:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 98 00000100:00100000:1.0:1784186551.829035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186551.829113:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915933184 00000100:00100000:3.0:1784186551.829123:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915933184 00000100:00100000:3.0:1784186551.829231:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 99 00000100:00100000:3.0:1784186551.829252:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+37:10497:x1870854915933184:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186551.829277:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186551.829296:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19834 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576615 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.829410:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1983b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.829435:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1983b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.829469:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1983b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186551.829484:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784186551.830040:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19834 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576615 expref: 40 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.830061:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1983b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576615 expref: 39 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.830069:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186551.830072:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784186551.830075:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504600, rc 0) 00000100:00100000:3.0:1784186551.830141:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+39:10497:x1870854915933184:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 900us (1115us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1784186551.830149:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 99 00000100:00100000:1.0:1784186551.835029:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186551.835111:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915932928 00000100:00100000:3.0:1784186551.835121:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915932928 00000100:00100000:3.0:1784186551.835189:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:3.0:1784186551.835200:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+39:2357:x1870854915932928:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186551.835218:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186551.835256:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57660e expref: 39 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.835292:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186551.835296:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186551.835657:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+38:2357:x1870854915932928:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 458us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186551.835665:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1784186551.841538:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.841624:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915933312 00000100:00100000:2.0:1784186551.841633:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915933312 00000100:00100000:2.0:1784186551.841677:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:2.0:1784186551.841684:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+10:2355:x1870854915933312:12345-192.168.201.31@tcp:1:lfs.0 00010000:00010000:2.0:1784186551.841721:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.841737:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 10 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.841743:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186551.841746:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186551.841749:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.841806:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 10 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.841822:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 10 pid: 6583 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186551.841835:0:6583:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6583:1870854937970304:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186551.841920:0:6583:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec6806b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784186551.845669:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186551.845760:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915933440 00000100:00100000:1.0:1784186551.845770:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915933440 00010000:00010000:1.0:1784186551.845818:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 11 pid: 6583 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186551.845859:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:1.0:1784186551.845868:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+11:2356:x1870854915933440:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186551.845882:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784186551.845903:0:11003:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1784186551.845906:0:11003:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784186551 00002000:00010000:1.0:1784186551.845908:0:11003:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1784186551 00010000:00010000:1.0:1784186551.845914:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 11 pid: 6583 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.845928:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 11 pid: 6583 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.845951:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186551.845955:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186551.845962:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.845984:0:11003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186551.846003:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186551.846061:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+11:2356:x1870854915933440:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 193us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186551.846068:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 50 00010000:00010000:2.0:1784186551.846417:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000882531b1/0x55bc3e8c99d1980a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576600 expref: 10 pid: 6583 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186551.846435:0:6583:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6583:1870854937970304:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186551.846504:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.846516:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.846523:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.846548:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.846569:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.846577:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.846584:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766dc00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186551.846588:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.846598:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.846610:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.846617:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7bd7ffb/0x55bc3e8c99d19849 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186551.846721:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2355:x1870854915933312:12345-192.168.201.31@tcp:1:lfs.0 Request processed in 5035us (5191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186551.846729:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:0.0:1784186551.853070:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186551.853171:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915933696 00000100:00100000:2.0:1784186551.853182:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915933696 00000100:00100000:2.0:1784186551.853263:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:2.0:1784186551.853281:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89b8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+38:10497:x1870854915933696:12345-192.168.201.31@tcp:35:lfs.0 00000004:00010000:2.0:1784186551.853338:0:5785:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1983b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576615 expref: 38 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784186551.853639:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1784186551.853667:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1784186551.853997:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1784186551.854040:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.854054:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d197f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f2 expref: 42 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.854061:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.854091:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d197f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f2 expref: 42 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.854105:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d197f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f2 expref: 42 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186551.854120:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5785:1870854937970432:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186551.854247:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec6806b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784186551.857611:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186551.857986:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915933824 00000100:00100000:3.0:1784186551.857995:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915933824 00010000:00010000:3.0:1784186551.858037:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d197f5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f2 expref: 43 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186551.858179:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5785:1870854937970432:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186551.858197:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:3.0:1784186551.858205:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+43:2356:x1870854915933824:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186551.858205:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.858223:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186551.858229:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d197f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f2 expref: 43 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.858241:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d197f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f2 expref: 43 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.858261:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d197f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765f2 expref: 43 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.858278:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186551.858283:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.858302:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.858310:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.858338:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186551.858480:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186551.858488:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784186551.858607:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1784186551.858801:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1784186551.858902:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5785:1870854937970560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784186551.858943:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186551.858967:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec6806f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186551.859025:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937970560 00000100:00100000:2.0:1784186551.859029:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937970560 00000100:00100000:2.0:1784186551.859067:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784186551.859073:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5785:x1870854937970560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784186551.859141:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5785:x1870854937970560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186551.859148:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1784186551.859166:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784186551.859185:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5785:1870854937970560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784186551.859689:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1784186551.859729:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5785:1870854937970688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784186551.859749:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186551.859760:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec6806b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784186551.859769:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937970688 00000100:00100000:2.0:1784186551.859772:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937970688 00000100:00100000:2.0:1784186551.859801:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784186551.859817:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5785:x1870854937970688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784186551.859901:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+45:2356:x1870854915933824:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 1695us (2298us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186551.859909:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:2.0:1784186551.859944:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5785:x1870854937970688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 131us (192us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784186551.859950:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186551.859966:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e10700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5785:1870854937970688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784186551.860004:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1784186551.860037:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.860045:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.860051:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.860057:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766ce00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186551.860061:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.860068:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.860080:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186551.860090:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784186551.860095:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.860101:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19850 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784186551.860338:0:5785:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784186551.861415:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1784186551.861482:0:5785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330583039902ns, next at 331582982663ns, rc = 0 00000001:00080000:0.0:1784186551.861493:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1784186551.861538:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:0.0:1784186551.861542:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784186551.861549:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1983b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576615 expref: 46 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186551.861639:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89b8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+45:10497:x1870854915933696:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 8358us (8577us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1784186551.861648:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 26 00000020:00080000:0.0:1784186551.861652:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784186551.863996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186551.864127:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915933952 00000100:00100000:3.0:1784186551.864135:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915933952 00000100:00100000:3.0:1784186551.864190:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 100 00000100:00100000:3.0:1784186551.864200:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+45:10497:x1870854915933952:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186551.864223:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186551.864247:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19857 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57661c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.864307:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19857 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57661c expref: 46 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.864323:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19857 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57661c expref: 46 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186551.864341:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:3.0:1784186551.864344:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784186551.864347:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505e00, rc 0) 00000100:00100000:3.0:1784186551.864434:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+46:10497:x1870854915933952:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 227us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186551.864472:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 100 00000100:00100000:1.0:1784186551.870830:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186551.870913:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915934208 00000100:00100000:0.0:1784186551.870937:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915934208 00000100:00100000:0.0:1784186551.870998:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:0.0:1784186551.871009:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+46:10497:x1870854915934208:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1784186551.871271:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+47:10497:x1870854915934208:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 262us (452us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1784186551.871279:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:1.0:1784186551.962280:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186551.962979:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915934336 00000100:00100000:0.0:1784186551.962988:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915934336 00000100:00100000:0.0:1784186551.963049:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:0.0:1784186551.963058:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+47:10507:x1870854915934336:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:0.0:1784186551.963137:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d1985e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963159:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d1985e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963171:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d1985e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963187:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963194:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963201:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963372:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1986c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963398:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963412:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784186551.963549:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963564:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d1985e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963571:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d1985e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963577:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d1985e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963583:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.963586:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d1985e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963592:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d1985e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963603:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:0.0:1784186551.963605:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.963609:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d1985e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963615:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d1985e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963633:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963638:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19865 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963643:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963648:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.963650:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963655:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19865 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963661:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fd011aa00) 00010000:00010000:0.0:1784186551.963663:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.963665:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19865 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963669:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963682:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1986c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963687:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1986c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963693:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1986c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963702:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186551.963706:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1986c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963710:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1986c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963715:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:0.0:1784186551.963716:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186551.963718:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1986c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186551.963721:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d1986c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186551.963868:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+47:10507:x1870854915934336:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 809us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186551.963877:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:0.0:1784186552.008098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.008138:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915934592 00000100:00100000:0.0:1784186552.008148:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915934592 00000100:00100000:0.0:1784186552.008198:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:0.0:1784186552.008208:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+47:10510:x1870854915934592:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186552.008227:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186552.008249:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19873 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576623 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.008318:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1987a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.008341:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1987a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009045:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1987a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009068:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009077:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009083:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009199:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009209:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009216:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186552.009227:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784186552.009321:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1987a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009329:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1987a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009337:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1987a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009365:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186552.009370:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1987a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009378:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1987a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009391:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:0.0:1784186552.009394:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186552.009398:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1987a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009405:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d1987a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009419:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009425:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19881 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009431:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009436:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186552.009469:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009476:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19881 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009497:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fd011aa00) 00010000:00010000:0.0:1784186552.009499:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186552.009501:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19881 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009507:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d19881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009549:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19873 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576623 expref: 50 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009564:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576623 expref: 49 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.009572:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:0.0:1784186552.009574:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784186552.009577:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128600, rc 0) 00000100:00100000:0.0:1784186552.009638:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+49:10510:x1870854915934592:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1431us (1548us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1784186552.009647:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:0.0:1784186552.018215:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.018301:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915934720 00000100:00100000:3.0:1784186552.018322:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915934720 00000100:00100000:3.0:1784186552.018380:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 103 00000100:00100000:3.0:1784186552.018391:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+49:10510:x1870854915934720:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:3.0:1784186552.018490:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19896 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.018508:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.018520:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.018547:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.018553:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.018559:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.018565:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186552.018569:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.018576:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19896 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.018586:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:3.0:1784186552.018589:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784186552.018593:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19896 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.018610:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19896 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186552.018674:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+49:10510:x1870854915934720:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 285us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186552.018682:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 103 00000100:00100000:1.0:1784186552.022717:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.022902:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915934976 00000100:00100000:0.0:1784186552.022913:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915934976 00000100:00100000:0.0:1784186552.022972:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:0.0:1784186552.022982:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+49:10510:x1870854915934976:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1784186552.023258:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+50:10510:x1870854915934976:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 277us (555us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1784186552.023284:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00000001:00080000:1.0:1784186552.092498:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:1.0:1784186552.092520:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1784186552.092526:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1784186552.092531:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1784186552.127701:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.127969:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915935232 00000100:00100000:3.0:1784186552.127981:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915935232 00000100:00100000:3.0:1784186552.128048:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 104 00000100:00100000:3.0:1784186552.128060:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+50:10520:x1870854915935232:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1784186552.128088:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186552.128091:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784186552.128122:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19818 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576607 expref: 50 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.128145:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186552.128150:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186552.128169:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d1989d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57662a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.128295:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d198a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.128310:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d198a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.128319:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d198a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186552.128350:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784186552.128566:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d1989d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57662a expref: 52 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.128583:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d198a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57662a expref: 51 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.128591:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:3.0:1784186552.128594:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186552.128597:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505c00, rc 0) 00000100:00100000:3.0:1784186552.128670:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+51:10520:x1870854915935232:12345-192.168.201.31@tcp:101:bash.0 Request processed in 612us (978us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1784186552.128678:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 104 00000100:00100000:0.0:1784186552.138917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.139032:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915935488 00000100:00100000:3.0:1784186552.139043:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915935488 00000100:00100000:3.0:1784186552.139098:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 105 00000100:00100000:3.0:1784186552.139107:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdd3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+51:10520:x1870854915935488:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:3.0:1784186552.139162:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784186552.139190:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d198a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57662a expref: 51 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.139213:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d19888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576623 expref: 50 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.139224:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:3.0:1784186552.139229:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186552.139485:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.139499:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.139509:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784186552.139561:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1784186552.139585:0:5782:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003e2c44c reply state 0000000090d799af transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186552.139594:0:5782:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784186552.139693:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdd3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+52:10520:x1870854915935488:12345-192.168.201.31@tcp:36:bash.0 Request processed in 586us (785us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1784186552.139700:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 105 00000020:00080000:3.0:1784186552.139705:0:5782:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784186552.153704:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00010000:00010000:3.0:1784186552.153977:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.153991:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.153999:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.154006:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186552.154012:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.154021:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.154058:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:3.0:1784186552.154061:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186552.154066:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.154073:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.155066:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915935616 00000100:00100000:0.0:1784186552.155080:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915935616 00000100:00100000:0.0:1784186552.155162:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 106 00000100:00100000:0.0:1784186552.155175:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+51:10520:x1870854915935616:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1784186552.155208:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186552.155235:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d198b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576631 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.155329:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.155343:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.155353:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186552.155384:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784186552.155389:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186552.155414:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.155484:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d198b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576631 expref: 53 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.155514:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576631 expref: 52 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.155536:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:0.0:1784186552.155540:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784186552.155543:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc0031000, rc 0) 00000100:00100000:0.0:1784186552.155623:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+52:10520:x1870854915935616:12345-192.168.201.31@tcp:101:bash.0 Request processed in 451us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186552.155631:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 106 00000100:00100000:1.0:1784186552.158900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.159726:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915935872 00000100:00100000:0.0:1784186552.159739:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915935872 00000100:00100000:0.0:1784186552.159818:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:0.0:1784186552.159829:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+52:10520:x1870854915935872:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:0.0:1784186552.160120:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+53:10520:x1870854915935872:12345-192.168.201.31@tcp:35:bash.0 Request processed in 292us (1230us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1784186552.160129:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:1.0:1784186552.231999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.232169:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915936000 00000100:00100000:3.0:1784186552.232180:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915936000 00000100:00100000:3.0:1784186552.232304:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00100000:3.0:1784186552.232315:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+53:10526:x1870854915936000:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186552.232341:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186552.232375:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576638 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.232492:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d198ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.232509:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d198ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.232521:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d198ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186552.232586:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1784186552.232590:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186552.232611:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d198ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.232654:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d198c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576638 expref: 55 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.232675:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d198ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576638 expref: 54 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.232683:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186552.232686:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186552.232689:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505c00, rc 0) 00000100:00100000:3.0:1784186552.232742:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+54:10526:x1870854915936000:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 428us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186552.232749:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00100000:2.0:1784186552.236606:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.236718:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915936128 00000100:00100000:0.0:1784186552.236728:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915936128 00000100:00100000:0.0:1784186552.236793:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 108 00000100:00100000:0.0:1784186552.236803:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+54:10526:x1870854915936128:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186552.236823:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186552.236845:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d198d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57663f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.236906:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d198dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.236920:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d198dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.236948:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d198dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.236967:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.236973:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.236979:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237206:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237216:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237223:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186552.237327:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784186552.237331:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186552.237360:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237373:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237382:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d198dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237399:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d198dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237406:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d198dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237413:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031a00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186552.237418:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d198dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237613:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d198dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237629:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:0.0:1784186552.237632:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186552.237637:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d198dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237642:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d198dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237657:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237663:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237668:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237673:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186552.237683:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237690:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237698:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fd011aa00) 00010000:00010000:0.0:1784186552.237701:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186552.237704:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237709:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237743:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d198d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57663f expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237756:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57663f expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.237763:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:0.0:1784186552.237765:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784186552.237976:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9129c00, rc 0) 00000100:00100000:0.0:1784186552.238127:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+55:10526:x1870854915936128:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1323us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186552.238136:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 108 00000100:00100000:1.0:1784186552.246941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186552.246993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.247070:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915936512 00000100:00100000:0.0:1784186552.247079:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915936512 00000100:00100000:0.0:1784186552.247138:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 109 00000100:00100000:0.0:1784186552.247149:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+55:10526:x1870854915936512:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186552.247185:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186552.247207:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576646 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.247322:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.247339:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576631 expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.247349:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57663f expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.247358:0:7478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.247398:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57663f expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.247413:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57663f expref: 56 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.247429:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937970816:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186552.247568:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576631 expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.247578:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576631 expref: 56 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.247601:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd540a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937970944:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186552.247628:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65600 going to sleep for 11 seconds 00000100:00100000:2.0:1784186552.248144:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915936256 00000100:00100000:2.0:1784186552.248151:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915936256 00010000:00010000:2.0:1784186552.248181:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57663f expref: 57 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186552.248217:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:2.0:1784186552.248229:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+57:2357:x1870854915936256:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186552.248242:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186552.248248:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57663f expref: 57 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.248260:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57663f expref: 57 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.248280:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:2.0:1784186552.248286:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.248294:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.248303:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186552.248354:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+57:2357:x1870854915936256:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 130us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.248362:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 52 00010000:00010000:0.0:1784186552.250151:0:7478:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.31@tcp) returned -22 from blocking AST (req@0000000038216274 x1870854937970816) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57663f expref: 56 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.250172:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d198ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57663f expref: 56 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.250188:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937970816:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186552.250198:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd540a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937970944:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186552.250226:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:0.0:1784186552.250231:0:7478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.250240:0:7478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.250248:0:7478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186552.251909:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.251999:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915936640 00000100:00100000:3.0:1784186552.252009:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915936640 00010000:00010000:3.0:1784186552.252051:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576631 expref: 56 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186552.252094:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:3.0:1784186552.252104:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+56:2357:x1870854915936640:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186552.252120:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186552.252127:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576631 expref: 56 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.252139:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576631 expref: 56 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.252183:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d198c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576631 expref: 56 pid: 5784 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.252199:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:3.0:1784186552.252203:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.252212:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.252220:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.252285:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186552.252339:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+55:2357:x1870854915936640:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 236us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186552.252347:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 53 00010000:00010000:0.0:1784186552.253744:0:7478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.253766:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186552.253813:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784186552.258402:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d198f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576646 expref: 56 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.258435:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576646 expref: 55 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.258497:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:1.0:1784186552.258501:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784186552.258505:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc9128400, rc 0) 00000100:00100000:1.0:1784186552.258595:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+55:10526:x1870854915936512:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 11445us (11599us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1784186552.258604:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 109 00000100:00100000:1.0:1784186552.269520:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186552.269781:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915936896 00000100:00100000:2.0:1784186552.269793:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915936896 00000100:00100000:2.0:1784186552.269873:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:2.0:1784186552.269883:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+55:10526:x1870854915936896:12345-192.168.201.31@tcp:103:lfs.0 00010000:00010000:2.0:1784186552.269899:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186552.269925:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19857 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57661c expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.269943:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:2.0:1784186552.269948:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186552.270010:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+54:10526:x1870854915936896:12345-192.168.201.31@tcp:103:lfs.0 Request processed in 129us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.270019:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:0.0:1784186552.273646:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186552.273755:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915937024 00000100:00100000:2.0:1784186552.273767:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915937024 00000100:00100000:2.0:1784186552.273831:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00100000:2.0:1784186552.273841:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+54:10526:x1870854915937024:12345-192.168.201.31@tcp:58:lfs.0 00010000:00010000:2.0:1784186552.273979:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.274000:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.274015:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784186552.274227:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1784186552.274338:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+54:10526:x1870854915937024:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 494us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.274347:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00100000:1.0:1784186552.277814:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.278154:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915937152 00000100:00100000:3.0:1784186552.278166:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915937152 00000100:00100000:2.0:1784186552.278367:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 111 00000100:00100000:2.0:1784186552.278379:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+54:10526:x1870854915937152:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186552.278399:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186552.278420:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1990d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57664d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.278507:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.278518:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1990d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57664d expref: 55 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.278536:0:5782:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.278548:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1990d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57664d expref: 55 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.278561:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:2.0:1784186552.278565:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784186552.278568:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1990d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57664d expref: 55 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.278595:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c400, rc 0) 00000100:00100000:2.0:1784186552.278663:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+55:10526:x1870854915937152:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 286us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.278670:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 111 00010000:00010000:1.0:1784186552.381839:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186552.509763:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd8a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937971072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784186552.509871:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186552.510121:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937971072 00000100:00100000:3.0:1784186552.510130:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937971072 00000100:00100000:3.0:1784186552.510186:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784186552.510196:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937971072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784186552.510220:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3855613952 00000100:00100000:3.0:1784186552.510278:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937971072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186552.510286:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784186552.510323:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1784186552.510341:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1784186552.510359:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b9ffe36ed80, transno 4294967301 00000004:00080000:3.0:1784186552.510369:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1784186552.510387:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd8a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937971072:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1784186552.511340:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784186552.511346:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784186552.511395:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1784186552.511401:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784186552.511551:0:11521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937971200:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784186552.511634:0:11521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186552.516838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186552.517093:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915937280 00000100:00100000:2.0:1784186552.517111:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915937280 00000100:00100000:2.0:1784186552.517184:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 112 00000100:00100000:2.0:1784186552.517194:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+56:10527:x1870854915937280:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784186552.517483:0:5783:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784186552.517589:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+56:10527:x1870854915937280:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 396us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.517598:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 112 00000100:00100000:0.0:1784186552.518554:0:11521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937971200:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784186552.523490:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.523694:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915937408 00000100:00100000:0.0:1784186552.523704:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915937408 00000100:00100000:0.0:1784186552.523784:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 113 00000100:00100000:0.0:1784186552.523794:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+55:10527:x1870854915937408:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784186552.523880:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19914 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.523897:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19914 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.523910:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19914 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.523925:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1991b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.523933:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1991b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.523957:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1991b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.523981:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19922 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.523990:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.523998:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186552.524035:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784186552.524040:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186552.524051:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524063:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19914 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524080:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19914 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524088:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19914 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524095:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186552.524365:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19914 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524378:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19914 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524400:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:0.0:1784186552.524404:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186552.524408:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19914 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524415:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d19914 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524432:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1991b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524438:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1991b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524488:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1991b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524494:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186552.524497:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1991b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524503:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1991b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524511:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9b9fd011aa00) 00010000:00010000:0.0:1784186552.524513:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186552.524516:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1991b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524522:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1991b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524548:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524555:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19922 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524562:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524567:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186552.524570:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524577:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19922 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524585:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:0.0:1784186552.524587:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186552.524590:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19922 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.524595:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19922 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.524674:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+55:10527:x1870854915937408:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 Request processed in 879us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186552.524683:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 113 00000100:00100000:1.0:1784186552.530928:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.531002:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915937664 00000100:00100000:3.0:1784186552.531012:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915937664 00000100:00100000:3.0:1784186552.531075:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 114 00000100:00100000:3.0:1784186552.531085:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+55:10527:x1870854915937664:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186552.531106:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186552.531127:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19929 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576654 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531223:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19930 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531241:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531252:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186552.531263:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784186552.531359:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19930 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531367:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19930 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531374:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531397:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186552.531402:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19930 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531409:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19930 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531422:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:3.0:1784186552.531425:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784186552.531430:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19930 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531435:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19930 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531512:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19929 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576654 expref: 57 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531523:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:3.0:1784186552.531525:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784186552.531529:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19929 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576654 expref: 57 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.531537:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504400, rc 0) 00000100:00100000:3.0:1784186552.531599:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+56:10527:x1870854915937664:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 515us (681us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1784186552.531607:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 114 00000100:00100000:1.0:1784186552.539606:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.539687:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915937792 00000100:00100000:0.0:1784186552.539699:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915937792 00000100:00100000:0.0:1784186552.539776:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 115 00000100:00100000:0.0:1784186552.539800:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+56:10527:x1870854915937792:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784186552.539835:0:7478:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784186552.539942:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+56:10527:x1870854915937792:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 143us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186552.539950:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 115 00000100:00100000:1.0:1784186552.543635:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.544079:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915938048 00000100:00100000:3.0:1784186552.544104:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915938048 00000100:00100000:3.0:1784186552.544165:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 116 00000100:00100000:3.0:1784186552.544175:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+56:10527:x1870854915938048:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186552.544196:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186552.544200:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784186552.544228:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d198ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576638 expref: 56 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.544249:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:3.0:1784186552.544254:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186552.544268:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1993e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57665b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784186552.544730:0:5784:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1784186552.545268:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.545284:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.545295:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.545527:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1993e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57665b expref: 58 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.545546:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57665b expref: 57 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.545572:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc7718a00) 00010000:00010000:3.0:1784186552.545575:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186552.545578:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504c00, rc 0) 00000100:00100000:3.0:1784186552.545649:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+57:10527:x1870854915938048:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 1474us (2022us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1784186552.545657:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 116 00000100:00100000:1.0:1784186552.552053:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.554211:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915938304 00000100:00100000:0.0:1784186552.554223:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915938304 00000100:00100000:0.0:1784186552.554295:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:0.0:1784186552.554304:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+57:10527:x1870854915938304:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784186552.554358:0:7478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186552.554380:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57665b expref: 57 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554396:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc7718a00) 00010000:00010000:0.0:1784186552.554405:0:7478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784186552.554422:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19953 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554432:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19953 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554477:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19953 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554530:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1995a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x72e27ce7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554538:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1995a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x72e27ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554560:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1995a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x72e27ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554622:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19953 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554627:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19953 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554631:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19953 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554634:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186552.554637:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19953 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554641:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19953 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554646:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:0.0:1784186552.554648:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186552.554651:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19953 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554655:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d19953 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554660:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1995a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x72e27ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554663:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1995a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x72e27ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554671:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1995a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x72e27ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554674:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186552.554676:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1995a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x72e27ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554679:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1995a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x72e27ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554684:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x72e27ce7 (ffff9b9fd011aa00) 00010000:00010000:0.0:1784186552.554685:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186552.554686:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1995a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x72e27ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.554689:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1995a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x72e27ce7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.554771:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+56:10527:x1870854915938304:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 458us (2721us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784186552.554778:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 117 00000100:00100000:1.0:1784186552.556796:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186552.556898:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915938432 00000100:00100000:2.0:1784186552.556907:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915938432 00000100:00100000:2.0:1784186552.556961:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:2.0:1784186552.556971:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+56:10527:x1870854915938432:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186552.556991:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186552.557012:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19961 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576662 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.557045:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19968 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.557086:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.557099:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.557190:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576662 expref: 58 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.557210:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576662 expref: 57 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.557218:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:2.0:1784186552.557221:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784186552.557231:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766dc00, rc 0) 00000100:00100000:2.0:1784186552.557289:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+57:10527:x1870854915938432:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 319us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.557297:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 118 00000100:00100000:1.0:1784186552.567060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.567155:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915938688 00000100:00100000:0.0:1784186552.567165:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915938688 00000100:00100000:0.0:1784186552.567238:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 119 00000100:00100000:0.0:1784186552.567248:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+57:10527:x1870854915938688:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784186552.567328:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1996f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.567344:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1996f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.567369:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1996f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784186552.567645:0:7478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1784186552.567654:0:7478:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331289212379ns, next at 332289210032ns, rc = 0 00000004:00010000:0.0:1784186552.567746:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000601c37cf reply state 00000000f56f7b23 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1996f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.567755:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784186552.567857:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+59:10527:x1870854915938688:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 610us (809us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1784186552.567864:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 119 00010000:00010000:3.0:1784186552.571610:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1996f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.571627:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1996f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.571634:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1996f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.571640:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186552.571644:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1996f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.571653:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1996f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.571670:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:3.0:1784186552.571673:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784186552.571678:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1996f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.571684:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d1996f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186552.573523:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186552.574529:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915938816 00000100:00100000:2.0:1784186552.574539:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915938816 00000100:00100000:2.0:1784186552.574600:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 120 00000100:00100000:2.0:1784186552.574611:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+58:10527:x1870854915938816:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186552.574636:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186552.574656:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19976 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576669 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.574708:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576669 expref: 59 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.574734:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576669 expref: 59 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.574749:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:2.0:1784186552.574751:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784186552.574755:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d400, rc 0) 00000100:00100000:2.0:1784186552.574834:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+59:10527:x1870854915938816:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 224us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.574842:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 120 00000100:00100000:1.0:1784186552.578419:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.578717:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915938944 00000100:00100000:0.0:1784186552.578726:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915938944 00000100:00100000:0.0:1784186552.578810:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:0.0:1784186552.578821:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffede4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2355:x1870854915938944:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784186552.579256:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffede4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2355:x1870854915938944:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 435us (845us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1784186552.579264:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:1.0:1784186552.590241:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.590375:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915939200 00000100:00100000:0.0:1784186552.590385:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915939200 00000100:00100000:0.0:1784186552.593500:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:0.0:1784186552.593526:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+59:10527:x1870854915939200:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784186552.594031:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+60:10527:x1870854915939200:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 515us (3799us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1784186552.594040:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:1.0:1784186552.601804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186552.602045:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915939456 00000100:00100000:2.0:1784186552.602055:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915939456 00000100:00100000:2.0:1784186552.602115:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:2.0:1784186552.602126:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+60:10527:x1870854915939456:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784186552.602255:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+60:10527:x1870854915939456:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 130us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.602263:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:3.0:1784186552.604910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186552.605296:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915939584 00000100:00100000:1.0:1784186552.605307:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915939584 00000100:00100000:1.0:1784186552.605381:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:1.0:1784186552.605392:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+60:10527:x1870854915939584:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784186552.605462:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186552.605492:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d1997d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576670 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.605572:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19984 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.605588:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.605600:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186552.605637:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784186552.605658:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19984 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.605683:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d1997d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576670 expref: 62 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.605703:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19984 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576670 expref: 61 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.605713:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186552.605716:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784186552.605720:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ede00, rc 0) 00000100:00100000:1.0:1784186552.605794:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+61:10527:x1870854915939584:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 403us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186552.605800:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 122 00000100:00100000:3.0:1784186552.620652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186552.620745:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915939712 00000100:00100000:2.0:1784186552.620755:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915939712 00000100:00100000:2.0:1784186552.620841:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:2.0:1784186552.620859:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2356:x1870854915939712:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186552.620878:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186552.620903:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1998b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576677 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784186552.620930:0:6583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5886b8, blocks: 0x1 00010000:00010000:2.0:1784186552.620960:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1784186552.620964:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186552.620975:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1998b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576677 expref: 10 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.620993:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1998b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576677 expref: 10 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.621008:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d800, rc 0) 00000100:00100000:2.0:1784186552.621071:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+10:2356:x1870854915939712:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 214us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.621079:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:2.0:1784186552.626786:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.626945:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915939968 00000100:00100000:0.0:1784186552.626956:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915939968 00000100:00100000:0.0:1784186552.627030:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:0.0:1784186552.627040:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+61:10527:x1870854915939968:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784186552.627169:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+61:10527:x1870854915939968:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 130us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186552.627178:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:1.0:1784186552.634547:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.634715:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915940096 00000100:00100000:3.0:1784186552.634726:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915940096 00000100:00100000:3.0:1784186552.634815:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:3.0:1784186552.634826:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+10:10527:x1870854915940096:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186552.634853:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186552.634872:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57667e expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.634907:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1998b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576677 expref: 11 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.634916:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186552.634920:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186552.634925:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.634958:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1998b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576677 expref: 11 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.634972:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1998b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576677 expref: 11 pid: 6583 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186552.634988:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd8aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870854937971328:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186552.635276:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd629ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1784186552.638559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.638657:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915940224 00000100:00100000:0.0:1784186552.638666:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915940224 00010000:00010000:0.0:1784186552.638710:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1998b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576677 expref: 12 pid: 6583 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.638779:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:0.0:1784186552.638790:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe55b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+12:2357:x1870854915940224:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186552.638807:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186552.638832:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1998b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576677 expref: 12 pid: 6583 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.638853:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1998b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576677 expref: 12 pid: 6583 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.638880:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186552.638885:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186552.638894:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.638926:0:5768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.638963:0:5768:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 12 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.638980:0:5768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5768:1870854937971456:192.168.201.31@tcp:105: 00000100:00100000:0.0:1784186552.639067:0:5768:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1784186552.641162:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054eb9e36/0x55bc3e8c99d1998b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576677 expref: 12 pid: 6583 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186552.641186:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd8aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870854937971328:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186552.641215:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 11 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.641229:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504400, rc 0) 00000100:00100000:1.0:1784186552.641294:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+11:10527:x1870854915940096:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 6469us (6757us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186552.641303:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:0.0:1784186552.647990:0:5768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5768:1870854937971456:192.168.201.31@tcp:105: 00010000:00010000:0.0:1784186552.648021:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186552.648084:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe55b3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+10:2357:x1870854915940224:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 9294us (9534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186552.648095:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:2.0:1784186552.650328:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.650595:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915940352 00000100:00100000:3.0:1784186552.650605:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915940352 00002000:00100000:2.0:1784186552.650730:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b9fc2e10700 x1870854915940352/t0(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:8/0 lens 504/0 e 0 to 0 dl 1784186563 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186552.650901:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9fc2e10700 with x1870854915940352 ext(0->12) 00002000:00010000:2.0:1784186552.650907:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9fc2e10700 00000100:00100000:2.0:1784186552.650986:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:2.0:1784186552.650997:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+10:2357:x1870854915940352:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784186552.651487:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+12:2357:x1870854915940352:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 Request processed in 491us (1167us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784186552.651496:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00002000:00100000:2.0:1784186552.651504:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9b9fc2e10700 x1870854915940352/t4294967308(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:8/0 lens 504/448 e 0 to 0 dl 1784186563 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186552.651524:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9fc2e10700 with x1870854915940352 ext(0->12) 00002000:00010000:2.0:1784186552.651528:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9fc2e10700 00000100:00100000:3.0:1784186552.654539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.654698:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915940480 00000100:00100000:0.0:1784186552.654709:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915940480 00000100:00100000:0.0:1784186552.654787:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00100000:0.0:1784186552.654798:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+61:10527:x1870854915940480:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784186552.683168:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1784186552.683188:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1784186552.683218:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:0.0:1784186552.683469:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937971712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1784186552.683546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186552.683595:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784186552.683603:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937971584:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784186552.683626:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186552.683655:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937971712 00000100:00100000:0.0:1784186552.683673:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937971712 00000100:00100000:0.0:1784186552.683711:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937971584 00000100:00100000:0.0:1784186552.683713:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937971584 00000100:00100000:0.0:1784186552.683723:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784186552.683728:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1870854937971712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1784186552.684005:0:6583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784186552.684009:0:6583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784186552 00002000:00010000:0.0:1784186552.684011:0:6583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784186552.684014:0:6583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1784186552 -> 1784186552 00002000:00010000:0.0:1784186552.684016:0:6583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784186552.684065:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1870854937971712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 334us (518us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784186552.684082:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1784186552.684201:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b9ec7297800/2, rc 0, transno 4294967309 00000100:00100000:3.0:1784186552.684207:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7297800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937971712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1784186552.684244:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784186552.684250:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1870854937971584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1784186552.684262:0:6583:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1784186552.684275:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.684291:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004ec84127/0x55bc3e8c99d1975b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765dd expref: 11 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.684298:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1784186552.684301:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784186552.684305:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.684324:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004ec84127/0x55bc3e8c99d1975b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765dd expref: 11 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.684339:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004ec84127/0x55bc3e8c99d1975b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765dd expref: 11 pid: 6583 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.684347:0:6583:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6583:1870854937971840:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186552.684402:0:6583:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21e480 going to sleep for 11 seconds 00000100:00080000:0.0:1784186552.684415:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1784186552.684531:0:5806:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b9fe5411480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1784186552.684537:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffe456900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b9fe5411e40 00000020:00080000:3.0:1784186552.684540:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffe456a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b9fefe0c000 00000020:00080000:3.0:1784186552.684588:0:5806:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b9ec6806e40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1784186552.684592:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffe456300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b9ec6806d80 00000020:00080000:3.0:1784186552.684595:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffe456500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b9fc9074c00 00000004:00080000:3.0:1784186552.684623:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1784186552.684733:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1784186552.684911:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1784186552.685323:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+15:10527:x1870854915940480:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 Request processed in 30524us (30792us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.685332:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 124 00000100:00100000:0.0:1784186552.687682:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937971968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784186552.687747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186552.687852:0:6581:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784186552.687862:0:6581:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1784186552.688265:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937971968 00000100:00100000:0.0:1784186552.688272:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937971968 00000100:00100000:2.0:1784186552.688433:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784186552.688478:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937971968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784186552.688520:0:11903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1784186552.688553:0:11903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a5886b7, atime: 0x0, ctime: 0x6a5886b7, blocks: 0xb 00010000:00010000:2.0:1784186552.688562:0:11903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4d59e42/0x55bc3e8c99d199a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.688577:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1784186552.688582:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186552.688589:0:11903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4d59e42/0x55bc3e8c99d199a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.688605:0:11903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4d59e42/0x55bc3e8c99d199a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.688616:0:11903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4d59e42/0x55bc3e8c99d199a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.688635:0:11903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4d59e42/0x55bc3e8c99d199a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.688654:0:11903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784186552.700002:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854937971968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9651us (10344us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784186552.700024:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:0.0:1784186552.700344:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b9fc2e10380/2, rc 0, transno 4294967304 00000100:00100000:0.0:1784186552.700354:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937971968:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1784186552.700479:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186552.700488:0:11501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4d59e42/0x55bc3e8c99d199a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.700500:0:11501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186552.700505:0:11501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4d59e42/0x55bc3e8c99d199a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.700516:0:11501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4d59e42/0x55bc3e8c99d199a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.700704:0:11501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4d59e42/0x55bc3e8c99d199a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.700712:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4d59e42/0x55bc3e8c99d199a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.700734:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186552.700736:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186552.700738:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186552.718848:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.718894:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186552.718910:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915940608 00000100:00100000:2.0:1784186552.718920:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915940608 00010000:00010000:2.0:1784186552.718964:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004ec84127/0x55bc3e8c99d1975b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765dd expref: 12 pid: 6583 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.718985:0:6583:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6583:1870854937971840:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186552.719007:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 55 00010000:00010000:0.0:1784186552.719010:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186552.719016:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+12:2356:x1870854915940608:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186552.719032:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186552.719037:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004ec84127/0x55bc3e8c99d1975b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765dd expref: 12 pid: 6583 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.719050:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004ec84127/0x55bc3e8c99d1975b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765dd expref: 12 pid: 6583 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186552.719068:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915940736 00000100:00100000:1.0:1784186552.719072:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915940736 00010000:00010000:2.0:1784186552.719086:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ec84127/0x55bc3e8c99d1975b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765dd expref: 13 pid: 6583 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186552.719111:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:1.0:1784186552.719118:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+12:2357:x1870854915940736:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1784186552.719123:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186552.719127:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186552.719133:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.719142:0:11003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.719164:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186552.719232:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+12:2356:x1870854915940608:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 207us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.719241:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 55 00010000:00010000:0.0:1784186552.719267:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.719276:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.719286:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.719294:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.719330:0:6583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784186552.719399:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186552.719407:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.719415:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128800 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186552.719420:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.719428:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.719456:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.719474:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e6786cb/0x55bc3e8c99d19999 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.719491:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186552.719492:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186552.719494:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186552.719936:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3308:x1870854937971584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 35683us (36305us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784186552.719943:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1784186552.719969:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b9ffe83ea00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1784186552.719976:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937971584:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1784186552.772781:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1784186552.772800:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1784186552.772811:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1784186552.773164:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915940736:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 Request processed in 54039us (54262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186552.773175:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:3.0:1784186552.776026:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.777011:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915940992 00000100:00100000:0.0:1784186552.777022:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915940992 00000100:00100000:0.0:1784186552.777106:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:0.0:1784186552.777116:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+15:10527:x1870854915940992:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784186552.777168:0:7478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186552.777194:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19984 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576670 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.777215:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:0.0:1784186552.777220:0:7478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784186552.777259:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.777272:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.777282:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784186552.777799:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006cec1bcc reply state 000000005ae5aeff transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.777823:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784186552.777934:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+16:10527:x1870854915940992:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 817us (1917us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1784186552.777942:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 125 00000100:00100000:0.0:1784186552.779915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00010000:00010000:3.0:1784186552.779922:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.779951:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.779959:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.779966:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186552.779971:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.779978:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.779995:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:3.0:1784186552.779999:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186552.780005:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.780011:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186552.780083:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915941120 00000100:00100000:2.0:1784186552.780092:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915941120 00000100:00100000:2.0:1784186552.780147:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:2.0:1784186552.780157:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915941120:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784186552.780414:0:11903:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1784186552.780420:0:11903:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1784186552 -> 1784186552 00002000:00010000:2.0:1784186552.780422:0:11903:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784186552 00002000:00010000:2.0:1784186552.780425:0:11903:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1784186552 -> 1784186552 00002000:00010000:2.0:1784186552.780427:0:11903:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1784186552.780502:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915941120:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 345us (595us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784186552.780510:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:1.0:1784186552.784096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.784175:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915941376 00000100:00100000:3.0:1784186552.784184:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915941376 00000100:00100000:3.0:1784186552.784241:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00100000:3.0:1784186552.784251:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+15:10527:x1870854915941376:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784186552.784323:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.784337:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19968 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576662 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.784360:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.784391:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576662 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.784400:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19968 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576662 expref: 15 pid: 5783 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186552.784413:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd8ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937972096:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186552.784510:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd629e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186552.789684:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186552.789876:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915941504 00000100:00100000:1.0:1784186552.789885:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915941504 00010000:00010000:1.0:1784186552.789926:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19968 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576662 expref: 16 pid: 5783 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186552.789968:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:1.0:1784186552.789978:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+16:2357:x1870854915941504:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186552.789994:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186552.790001:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19968 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576662 expref: 16 pid: 5783 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.790027:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19968 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576662 expref: 16 pid: 5783 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.790051:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186552.790057:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.790067:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.790076:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.790095:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186552.790160:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+16:2357:x1870854915941504:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 182us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186552.790167:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00010000:00010000:2.0:1784186552.791864:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19968 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576662 expref: 15 pid: 5783 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186552.791892:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd8ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937972096:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186552.791934:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.792109:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.792117:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.792152:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.792160:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.792166:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.792172:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186552.792177:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.792184:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.792201:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:0.0:1784186552.792203:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784186552.792207:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.792217:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d199ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.792383:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+14:10527:x1870854915941376:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 Request processed in 8132us (8296us total) trans 0 rc -22/-22 00000100:00100000:0.0:1784186552.792393:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 126 00000100:00100000:3.0:1784186552.794917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.794966:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915941632 00000100:00100000:0.0:1784186552.794977:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915941632 00000100:00100000:0.0:1784186552.795041:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:0.0:1784186552.795051:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2356:x1870854915941632:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784186552.795199:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.795217:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.795274:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186552.795278:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784186552.795282:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.795313:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 7 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.795323:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 7 pid: 6581 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.795347:0:6583:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6583:1870854937972224:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186552.795522:0:6583:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc66dd900 going to sleep for 11 seconds 00000100:00100000:2.0:1784186552.798528:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186552.798952:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915941760 00000100:00100000:1.0:1784186552.798962:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915941760 00010000:00010000:1.0:1784186552.799009:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 8 pid: 6581 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186552.799098:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:1.0:1784186552.799109:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2356:x1870854915941760:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186552.799128:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186552.799154:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 8 pid: 6581 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.799191:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 8 pid: 6581 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.799219:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186552.799224:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186552.799231:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.799242:0:11003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.799265:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186552.799334:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2356:x1870854915941760:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 227us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186552.799344:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00010000:00010000:0.0:1784186552.818360:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bd6cddc/0x55bc3e8c99d19992 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57667e expref: 7 pid: 6581 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.818383:0:6583:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6583:1870854937972224:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186552.818412:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.818426:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.818434:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.818488:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.818497:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.818505:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.818542:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186552.818547:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.818556:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.818577:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.818586:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099091857/0x55bc3e8c99d199b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.821406:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2356:x1870854915941632:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 Request processed in 26344us (26484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186552.821420:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:3.0:1784186552.824302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186552.825552:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915942016 00000100:00100000:1.0:1784186552.825564:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915942016 00000100:00100000:1.0:1784186552.825633:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 127 00000100:00100000:1.0:1784186552.825643:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+14:10527:x1870854915942016:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784186552.825728:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d199bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.825747:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d199bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.825767:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d199bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.826354:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.826370:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19976 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576669 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.826379:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.826415:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576669 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.826429:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19976 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576669 expref: 15 pid: 5783 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186552.826541:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937972352:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186552.826641:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc6fe9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186552.841006:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186552.841040:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937972352:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186552.841199:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915942144 00000100:00100000:2.0:1784186552.841206:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915942144 00010000:00010000:2.0:1784186552.841255:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19976 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576669 expref: 16 pid: 5783 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186552.841297:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:2.0:1784186552.841307:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+16:2357:x1870854915942144:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186552.841324:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186552.841332:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19976 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576669 expref: 16 pid: 5783 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.841342:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19976 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576669 expref: 16 pid: 5783 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.841365:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19976 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576669 expref: 16 pid: 5783 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.841381:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:2.0:1784186552.841386:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.841394:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.841402:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.841437:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186552.841538:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+15:2357:x1870854915942144:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 231us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.841546:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 58 00010000:00010000:1.0:1784186552.841981:0:5782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.841992:0:5782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.841998:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784186552.842503:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1784186552.842688:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1784186552.842740:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1784186552.844433:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5782:1870854937972480:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784186552.844618:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186552.844699:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcd745540 going to sleep for 11 seconds 00000100:00100000:2.0:1784186552.847018:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937972480 00000100:00100000:2.0:1784186552.847034:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937972480 00000100:00100000:2.0:1784186552.847923:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784186552.847939:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5782:x1870854937972480:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784186552.848086:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5782:x1870854937972480:12345-0@lo:1000:mdt00_000.0 Request processed in 153us (3467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186552.848212:0:5782:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1784186552.848219:0:5782:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1784186552.848252:0:5782:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b9ec7297800, transno 4294967309 00000004:00080000:1.0:1784186552.848272:0:5782:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b9ffe83ea00, transno 4294967310 00000100:00100000:1.0:1784186552.848281:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5782:1870854937972480:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1784186552.848963:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1784186552.849048:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5782:1870854937972608:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784186552.849124:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186552.849240:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784186552.852962:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc6fe9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186552.853186:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937972608 00000100:00100000:3.0:1784186552.853195:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937972608 00000100:00100000:3.0:1784186552.853250:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784186552.853260:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5782:x1870854937972608:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784186552.853584:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5782:x1870854937972608:12345-0@lo:1000:mdt00_000.0 Request processed in 324us (4458us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1784186552.853592:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784186552.854579:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5782:1870854937972608:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1784186552.854627:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854638:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854646:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854653:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186552.854657:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854664:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854705:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186552.854707:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186552.854713:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854720:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d199c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854753:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854767:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854774:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854779:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766da00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186552.854782:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854787:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854796:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:1.0:1784186552.854807:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186552.854816:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1990d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57664d expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854826:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1990d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57664d expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854843:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1990d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57664d expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.854885:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1990d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57664d expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186552.854900:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe273480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937972736:192.168.201.31@tcp:105: 00000100:00100000:1.0:1784186552.854980:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc6fe9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186552.857945:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186552.858082:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe273480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937972736:192.168.201.31@tcp:105: 00010000:00010000:2.0:1784186552.858119:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858130:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19906 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858169:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d199ca lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858183:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d199ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858194:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d199ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858205:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d199ca lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858238:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d199ca lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858244:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d199ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858250:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186552.858254:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d199ca lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858261:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d199ca lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858274:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:2.0:1784186552.858277:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186552.858280:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d199ca lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858285:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d199ca lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858294:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d199bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858300:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d199bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858305:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d199bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858310:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ede00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186552.858318:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d199bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858324:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d199bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858332:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:2.0:1784186552.858334:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784186552.858337:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d199bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.858342:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d199bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186552.858583:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+18:10527:x1870854915942016:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 32940us (34288us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1784186552.858594:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 127 00000020:00080000:2.0:1784186552.858601:0:5782:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1784186552.858886:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915942272 00000100:00100000:0.0:1784186552.858896:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915942272 00000100:00100000:0.0:1784186552.858948:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:0.0:1784186552.858959:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+18:10526:x1870854915942272:12345-192.168.201.31@tcp:49:lfs.0 00000100:00100000:0.0:1784186552.859056:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+18:10526:x1870854915942272:12345-192.168.201.31@tcp:49:lfs.0 Request processed in 99us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186552.859063:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000040:00080000:3.0:1784186552.859551:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784186552.859556:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186552.861112:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1784186552.861135:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784186552.863645:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.863785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186552.863913:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915942784 00000100:00100000:2.0:1784186552.863921:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915942784 00000100:00100000:2.0:1784186552.863978:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 128 00000100:00100000:2.0:1784186552.863988:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+18:10526:x1870854915942784:12345-192.168.201.31@tcp:58:lfs.0 00000040:00080000:2.0:1784186552.864653:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1784186552.864753:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+18:10526:x1870854915942784:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 764us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.864769:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 128 00000100:00100000:0.0:1784186552.869976:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915942528 00000100:00100000:0.0:1784186552.870009:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915942528 00000100:00100000:1.0:1784186552.870482:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:1.0:1784186552.870494:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+18:10527:x1870854915942528:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784186552.871720:0:5785:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784186552.872012:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1784186552.872197:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d199d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.872215:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d199d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.872297:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d199d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.872306:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d199d1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.872312:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d199d1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.872317:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d199d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186552.872405:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784186552.872565:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+20:10527:x1870854915942528:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 2070us (8925us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1784186552.872576:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 32 00000020:00080000:1.0:1784186552.872582:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784186552.876654:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186552.876670:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d199d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.876682:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ece00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186552.876686:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d199d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.876695:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d199d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.876714:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9b9fd1d53500) 00010000:00010000:3.0:1784186552.876718:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784186552.876722:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d199d1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.876728:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d199d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.876961:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186552.876963:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186552.876966:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186552.899018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186552.899174:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915942912 00000100:00100000:0.0:1784186552.899183:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915942912 00000100:00100000:0.0:1784186552.899237:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 129 00000100:00100000:0.0:1784186552.899244:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+20:10529:x1870854915942912:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186552.899263:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186552.899281:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d199d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576685 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.899329:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d199df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.899340:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d199df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.899347:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d199df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.899360:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.899368:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.899374:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.899718:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.899729:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576646 expref: 21 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.899748:0:7478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.899790:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576646 expref: 21 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186552.899812:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576646 expref: 21 pid: 7478 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186552.899825:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5495500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937972864:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186552.900525:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc66dd900 going to sleep for 11 seconds 00000100:00100000:2.0:1784186552.902969:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5495500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937972864:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186552.902998:0:7478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186552.903349:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186552.903649:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915943168 00000100:00100000:2.0:1784186552.903656:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915943168 00000100:00100000:2.0:1784186552.903774:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:2.0:1784186552.903785:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+22:5570:x1870854915943168:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784186552.904056:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+23:5570:x1870854915943168:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 272us (707us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1784186552.904065:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:0.0:1784186552.908542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186552.908703:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915943296 00000100:00100000:3.0:1784186552.908713:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915943296 00010000:00010000:3.0:1784186552.908753:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576646 expref: 23 pid: 7478 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186552.908890:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:3.0:1784186552.908901:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+23:2357:x1870854915943296:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186552.908917:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186552.908924:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576646 expref: 23 pid: 7478 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.908984:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576646 expref: 23 pid: 7478 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.909010:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128400/0x55bc3e8c99d198f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576646 expref: 23 pid: 7478 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.909027:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:3.0:1784186552.909032:0:5767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.909041:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.909048:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186552.909080:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186552.909142:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+22:2357:x1870854915943296:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 242us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186552.909149:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00010000:00010000:2.0:1784186552.909581:0:7478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909591:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186552.909633:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784186552.909638:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186552.909658:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909671:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909680:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d199df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909686:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d199df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909691:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d199df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909710:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186552.909714:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d199df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909722:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d199df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909732:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:2.0:1784186552.909735:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186552.909739:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d199df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909745:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128800/0x55bc3e8c99d199df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909767:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909773:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909779:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909784:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9129c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186552.909787:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909793:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909821:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9b9fd011aa00) 00010000:00010000:2.0:1784186552.909824:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186552.909827:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909833:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129c00/0x55bc3e8c99d199e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909879:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9128600/0x55bc3e8c99d199d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576685 expref: 22 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909893:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576685 expref: 21 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186552.909900:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:2.0:1784186552.909902:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186552.909904:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc0031000, rc 0) 00000100:00100000:2.0:1784186552.909958:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10529:x1870854915942912:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 10714us (10952us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186552.909966:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 129 00010000:00010000:0.0:1784186553.406565:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186553.533613:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937973248:0@lo:400:kworker.0 00000100:00100000:2.0:1784186553.533674:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937972992:0@lo:400:kworker.0 00000100:00100000:1.0:1784186553.533684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186553.533727:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186553.533745:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784186553.533767:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937973504:0@lo:400:kworker.0 00000100:00100000:2.0:1784186553.533809:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186553.533841:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784186553.533849:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937973120:0@lo:400:kworker.0 00000100:00100000:2.0:1784186553.533897:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186553.533925:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937973632:0@lo:400:kworker.0 00000100:00100000:0.0:1784186553.533953:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937973248 00000100:00100000:2.0:1784186553.533956:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186553.533963:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937973248 00000100:00100000:2.0:1784186553.534002:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937972992 00000100:00100000:2.0:1784186553.534006:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937972992 00000100:00100000:0.0:1784186553.534021:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937973504 00000100:00100000:0.0:1784186553.534023:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937973504 00000100:00100000:0.0:1784186553.534036:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937973120 00000100:00100000:0.0:1784186553.534039:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937973120 00000100:00100000:2.0:1784186553.534050:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1784186553.534051:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1784186553.534059:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937972992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186553.534059:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937973248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186553.534127:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937973376:0@lo:400:kworker.0 00000100:00100000:2.0:1784186553.536633:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937972992:12345-0@lo:400:kworker.0 Request processed in 2566us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186553.536648:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1784186553.536711:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784186553.536911:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937973504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186553.536944:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937973248:12345-0@lo:400:kworker.0 Request processed in 2885us (3258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186553.536951:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784186553.536970:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784186553.536978:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937973120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186553.537027:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937973504:12345-0@lo:400:kworker.0 Request processed in 145us (3214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186553.537036:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784186553.537249:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe271c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937972992:0@lo:400:kworker.0 00000100:00100000:2.0:1784186553.537266:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937973504:0@lo:400:kworker.0 00000100:00080000:2.0:1784186553.538253:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186553.538271:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937973632 00000100:00100000:2.0:1784186553.538389:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937973632 00000100:00100000:2.0:1784186553.539184:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784186553.539236:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1870854937973632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186553.543390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186553.543512:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe273480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937973248:0@lo:400:kworker.0 00000100:00100000:1.0:1784186553.546838:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937973376 00000100:00100000:1.0:1784186553.546853:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937973376 00000100:00100000:1.0:1784186553.546944:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784186553.546955:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937973376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186553.547065:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937973376:12345-0@lo:400:kworker.0 Request processed in 113us (3686us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186553.547073:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784186553.547129:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937973376:0@lo:400:kworker.0 00000100:00100000:2.0:1784186553.548290:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1870854937973632:12345-0@lo:400:kworker.0 Request processed in 9057us (14326us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186553.548301:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1784186553.548338:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784186553.550524:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937973632:0@lo:400:kworker.0 00000100:00100000:0.0:1784186553.550740:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937973120:12345-0@lo:400:kworker.0 Request processed in 13760us (16839us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186553.550760:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784186553.551075:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe273800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937973120:0@lo:400:kworker.0 00000040:00080000:2.0:1784186553.756779:0:11941:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784186553.756788:0:11941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784186553.756957:0:11941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1784186553.756964:0:11941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1784186553.929536:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784186553.929546:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784186553.929604:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784186553.929612:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784186553.929734:0:11521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5497b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937973760:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784186553.930596:0:11521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe547cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784186553.939564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186553.939692:0:11521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5497b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937973760:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784186553.941232:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915943424 00000100:00100000:2.0:1784186553.941246:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915943424 00000100:00100000:2.0:1784186553.941335:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 130 00000100:00100000:2.0:1784186553.941346:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10541:x1870854915943424:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784186553.941383:0:5783:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784186553.941525:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10541:x1870854915943424:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 180us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186553.941533:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 130 00000100:00080000:3.0:1784186553.941769:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186553.954351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186553.954470:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915943680 00000100:00100000:0.0:1784186553.954481:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915943680 00000100:00100000:0.0:1784186553.954542:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 131 00000100:00100000:0.0:1784186553.954553:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+21:10541:x1870854915943680:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784186553.954586:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186553.954849:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d199f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57668c expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186553.954954:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d199fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186553.954970:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d199fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186553.954982:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d199fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186553.954994:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784186553.955136:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031a00/0x55bc3e8c99d199f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57668c expref: 24 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186553.955260:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d199fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57668c expref: 23 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186553.955270:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:0.0:1784186553.955274:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784186553.955278:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc0031e00, rc 0) 00000100:00100000:0.0:1784186553.955343:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+23:10541:x1870854915943680:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 792us (1005us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1784186553.955351:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 131 00000100:00100000:2.0:1784186553.959908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186553.967705:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915943808 00000100:00100000:0.0:1784186553.967794:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915943808 00000100:00100000:0.0:1784186553.967951:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:0.0:1784186553.967962:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+23:2354:x1870854915943808:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186553.967979:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186553.968003:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d199fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57668c expref: 23 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186553.968020:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:0.0:1784186553.968025:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186553.968105:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+22:2354:x1870854915943808:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 144us (8205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186553.968113:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:2.0:1784186553.969976:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186553.970048:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915944064 00000100:00100000:3.0:1784186553.970057:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915944064 00000100:00100000:3.0:1784186553.970115:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 132 00000100:00100000:3.0:1784186553.970125:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+22:10541:x1870854915944064:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784186553.970206:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186553.970223:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186553.970235:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186553.970410:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186553.970418:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186553.970425:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186553.970431:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186553.970435:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186553.970464:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186553.970476:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:3.0:1784186553.970485:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784186553.970490:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186553.970497:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186553.970625:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+23:10541:x1870854915944064:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 501us (655us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1784186553.970632:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 132 00000040:00080000:3.0:1784186553.970725:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784186553.970729:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186553.972315:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1784186553.972328:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784186553.973716:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186553.978176:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915944320 00000100:00100000:1.0:1784186553.978212:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915944320 00000100:00100000:1.0:1784186553.978289:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:1.0:1784186553.978301:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+23:10541:x1870854915944320:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784186553.978592:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+24:10541:x1870854915944320:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 292us (4882us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1784186553.978601:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:3.0:1784186554.046693:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784186554.047187:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937973888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784186554.047263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186554.047588:0:11527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937973888 00000100:00100000:1.0:1784186554.047597:0:11527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937973888 00000100:00100000:1.0:1784186554.047661:0:11527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784186554.047671:0:11527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854937973888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784186554.047696:0:11527:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1784186554.047766:0:11527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854937973888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186554.047774:0:11527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1784186554.048221:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186554.048268:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937973888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784186554.429883:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186555.459071:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186555.728410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186555.728481:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186555.728516:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186555.728538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186555.728576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186555.728616:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915944448 00000100:00100000:2.0:1784186555.728625:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915944448 00000100:00100000:2.0:1784186555.728675:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 287 00000100:00100000:2.0:1784186555.728684:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2355:x1870854915944448:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186555.728762:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2355:x1870854915944448:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186555.728781:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 287 00000100:00100000:2.0:1784186555.728825:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915944576 00000100:00100000:2.0:1784186555.728829:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915944576 00000100:00100000:2.0:1784186555.728870:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915944960 00000100:00100000:2.0:1784186555.728873:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915944960 00000100:00100000:2.0:1784186555.728891:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 137 00000100:00100000:2.0:1784186555.728896:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+24:2355:x1870854915944576:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186555.728928:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+24:2355:x1870854915944576:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 31us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186555.728934:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 137 00000100:00100000:2.0:1784186555.728944:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 138 00000100:00100000:2.0:1784186555.728949:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2355:x1870854915944960:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186555.728969:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2355:x1870854915944960:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 19us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186555.728974:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 138 00000100:00080000:2.0:1784186555.729087:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186555.733499:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915944832 00000100:00100000:1.0:1784186555.733512:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915944832 00000100:00080000:3.0:1784186555.733629:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784186555.733943:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915944704 00000100:00100000:1.0:1784186555.733948:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915944704 00000100:00100000:1.0:1784186555.733984:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:1.0:1784186555.733994:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2355:x1870854915944832:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186555.734078:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe273800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2355:x1870854915944832:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 85us (5595us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186555.734085:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:1.0:1784186555.734105:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:1.0:1784186555.734111:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915944704:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186555.734137:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915944704:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 26us (5598us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186555.734150:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00080000:1.0:1784186555.736506:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1784186555.803938:0:11993:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784186555.803948:0:11993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784186555.803997:0:11993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784186555.804011:0:11993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784186556.092603:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186556.092853:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915945216 00000100:00100000:3.0:1784186556.092867:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915945216 00000100:00100000:3.0:1784186556.092931:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 133 00000100:00100000:3.0:1784186556.092942:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+24:10561:x1870854915945216:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186556.092966:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186556.092992:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19a10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576693 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186556.093084:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186556.093096:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186556.093106:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186556.093115:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784186556.094857:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19a10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576693 expref: 27 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186556.094880:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576693 expref: 26 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186556.094887:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:3.0:1784186556.094889:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784186556.094891:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504200, rc 0) 00000100:00100000:3.0:1784186556.094960:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+26:10561:x1870854915945216:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 2020us (2369us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1784186556.094966:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 133 00000100:00100000:3.0:1784186556.098257:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186556.098380:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915945344 00000100:00100000:0.0:1784186556.098388:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915945344 00000100:00100000:0.0:1784186556.098437:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 134 00000100:00100000:0.0:1784186556.098465:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+26:10561:x1870854915945344:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:0.0:1784186556.098529:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19a25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186556.098547:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186556.098559:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186556.098585:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186556.098592:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19a25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186556.098599:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186556.098603:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031e00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186556.098607:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186556.098611:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19a25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186556.098620:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:0.0:1784186556.098622:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784186556.098632:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19a25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186556.098636:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031e00/0x55bc3e8c99d19a25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186556.098691:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+26:10561:x1870854915945344:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 226us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186556.098698:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 134 00000100:00100000:0.0:1784186556.241556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186556.241999:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915945472 00000100:00100000:1.0:1784186556.242009:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915945472 00000100:00100000:1.0:1784186556.242081:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:1.0:1784186556.242092:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2356:x1870854915945472:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:1.0:1784186556.242113:0:11903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186556.242137:0:11903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006200421a/0x55bc3e8c99d19a2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57669a expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784186556.242165:0:11903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a5886b8, atime: 0x6a5886b8, ctime: 0x6a5886b8, blocks: 0xb 00010000:00010000:1.0:1784186556.242187:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1784186556.242192:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186556.242204:0:11903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006200421a/0x55bc3e8c99d19a2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57669a expref: 7 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186556.242223:0:11903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006200421a/0x55bc3e8c99d19a2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57669a expref: 7 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186556.242237:0:11903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ed800, rc 0) 00000100:00100000:1.0:1784186556.242312:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2356:x1870854915945472:12345-192.168.201.31@tcp:101:cat.0 Request processed in 222us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186556.242319:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:3.0:1784186556.248014:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186556.251609:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915945600 00000100:00100000:2.0:1784186556.251624:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915945600 00002000:00100000:2.0:1784186556.251922:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b9fccc13480 x1870854915945600/t0(0) o3->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:12/0 lens 488/0 e 0 to 0 dl 1784186567 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186556.251935:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9fccc13480 with x1870854915945600 ext(0->4095) 00002000:00010000:2.0:1784186556.251942:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9fccc13480 00000100:00100000:2.0:1784186556.252045:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:2.0:1784186556.252055:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2357:x1870854915945600:12345-192.168.201.31@tcp:3:cat.0 00000100:00100000:2.0:1784186556.252322:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2357:x1870854915945600:12345-192.168.201.31@tcp:3:cat.0 Request processed in 267us (4316us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784186556.252345:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00002000:00100000:2.0:1784186556.252353:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9b9fccc13480 x1870854915945600/t0(0) o3->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:12/0 lens 488/4536 e 0 to 0 dl 1784186567 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186556.252362:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9fccc13480 with x1870854915945600 ext(0->4095) 00002000:00010000:2.0:1784186556.252365:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9fccc13480 00010000:00010000:0.0:1784186556.477691:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784186557.217611:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:1.0:1784186557.502048:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186557.629764:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937974016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784186557.629835:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186557.629943:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937974016 00000100:00100000:3.0:1784186557.629950:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937974016 00000100:00100000:3.0:1784186557.630011:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784186557.630018:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937974016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784186557.630050:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186557.630088:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937974016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186557.630094:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784186557.630140:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1784186557.630146:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b9fc2e10380, transno 4294967304 00000100:00100000:3.0:1784186557.630168:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937974016:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784186557.630413:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1784186558.194242:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1784186558.194283:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1784186558.236265:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:3.0:1784186558.236286:0:5806:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1784186558.236305:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1784186558.236321:0:5806:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b9ffec65540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1784186558.236326:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffee2e500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b9fcce54c00 00000020:00080000:3.0:1784186558.236329:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffee2e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b9ffed25c00 00000001:00080000:3.0:1784186558.236351:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1784186558.236405:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1784186558.236918:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1784186558.526991:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186558.656904:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937974400:0@lo:400:kworker.0 00000100:00100000:0.0:1784186558.656963:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937974144:0@lo:400:kworker.0 00000100:00100000:2.0:1784186558.656976:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186558.656998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186558.657038:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784186558.657045:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937974528:0@lo:400:kworker.0 00000100:00100000:1.0:1784186558.657060:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937974400 00000100:00100000:1.0:1784186558.657073:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937974400 00000100:00100000:2.0:1784186558.657083:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186558.657117:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937974528 00000100:00100000:2.0:1784186558.657121:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937974528 00000100:00100000:1.0:1784186558.657129:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784186558.657137:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937974400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186558.657146:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784186558.657151:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937974528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186558.657194:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937974400:12345-0@lo:400:kworker.0 Request processed in 57us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186558.657203:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784186558.661990:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937974272:0@lo:400:kworker.0 00000100:00100000:1.0:1784186558.662083:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186558.662135:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937974784:0@lo:400:kworker.0 00000100:00100000:1.0:1784186558.662161:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186558.662203:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937974784 00000100:00100000:1.0:1784186558.662209:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937974784 00000100:00100000:1.0:1784186558.662267:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784186558.662276:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937974784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186558.662329:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937974784:12345-0@lo:400:kworker.0 Request processed in 54us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186558.662336:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784186558.662402:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1784186558.662408:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1784186558.662428:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937974784:0@lo:400:kworker.0 00000100:00100000:2.0:1784186558.666931:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937974528:12345-0@lo:400:kworker.0 Request processed in 9766us (9834us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186558.666950:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1784186558.667057:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937974528:0@lo:400:kworker.0 00000100:00100000:2.0:1784186558.667074:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937974400:0@lo:400:kworker.0 00000100:00080000:1.0:1784186558.670551:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186558.670561:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186558.670582:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937974144 00000100:00100000:1.0:1784186558.670593:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937974144 00000100:00100000:1.0:1784186558.670653:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1784186558.670673:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937974144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186558.670788:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937974144:12345-0@lo:400:kworker.0 Request processed in 125us (13787us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186558.670797:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1784186558.673502:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937974272 00000100:00100000:1.0:1784186558.673517:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937974272 00000100:00100000:1.0:1784186558.673640:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784186558.673660:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937974272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186558.673903:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1870854937974272:12345-0@lo:400:kworker.0 Request processed in 244us (11819us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186558.673911:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784186558.674018:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe557a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937974144:0@lo:400:kworker.0 00000100:00100000:0.0:1784186558.674034:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe311f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937974656:0@lo:400:kworker.0 00000100:00100000:0.0:1784186558.674077:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186558.690290:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937974656 00000100:00100000:2.0:1784186558.690305:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937974656 00000100:00100000:2.0:1784186558.690860:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784186558.690873:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937974656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186558.690966:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937974656:12345-0@lo:400:kworker.0 Request processed in 97us (16888us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186558.690987:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1784186558.691021:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186558.692235:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1870854937974272:0@lo:400:kworker.0 00000100:00100000:1.0:1784186558.693214:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe311f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937974656:0@lo:400:kworker.0 00000040:00080000:0.0:1784186559.105079:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784186559.105088:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784186559.105121:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784186559.105129:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784186559.171937:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186559.171961:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937974912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186559.172035:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186559.172104:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937974912 00000100:00100000:0.0:1784186559.172111:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937974912 00000100:00100000:0.0:1784186559.172159:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784186559.172169:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937974912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186559.172206:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186559.172252:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937974912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186559.172259:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784186559.172309:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6f87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937974912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784186559.550252:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186560.577907:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186560.856678:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186560.856730:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186560.856768:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915946112 00000100:00100000:3.0:1784186560.856778:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915946112 00000100:00100000:3.0:1784186560.856845:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:3.0:1784186560.856856:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915946112:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186560.856949:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915946112:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 94us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186560.856958:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:1.0:1784186560.856979:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915945856 00000100:00100000:1.0:1784186560.856985:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915945856 00000100:00100000:1.0:1784186560.857026:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00100000:1.0:1784186560.857035:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+13:2354:x1870854915945856:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186560.857092:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+13:2354:x1870854915945856:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 59us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186560.857101:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00080000:0.0:1784186560.857271:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784186560.857277:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186560.858293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186560.858320:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186560.858341:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186560.858361:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915945728 00000100:00100000:3.0:1784186560.858368:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915945728 00000100:00100000:3.0:1784186560.858399:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 289 00000100:00100000:3.0:1784186560.858407:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915945728:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186560.858475:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915945728:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 68us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186560.858482:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 289 00000100:00100000:1.0:1784186560.858999:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915946240 00000100:00100000:1.0:1784186560.859004:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915946240 00000100:00100000:1.0:1784186560.859038:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 143 00000100:00100000:1.0:1784186560.859046:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915946240:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186560.859089:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915946240:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 43us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186560.859095:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 143 00000100:00100000:2.0:1784186560.859779:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915945984 00000100:00100000:2.0:1784186560.859786:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915945984 00000100:00080000:0.0:1784186560.859795:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784186560.859801:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784186560.859834:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 83 00000100:00100000:2.0:1784186560.859842:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2354:x1870854915945984:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186560.859886:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2354:x1870854915945984:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 45us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186560.859892:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 83 00000100:00100000:2.0:1784186561.081618:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186561.081712:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915946368 00000100:00100000:1.0:1784186561.081722:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915946368 00000100:00100000:1.0:1784186561.081777:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 135 00000100:00100000:1.0:1784186561.081786:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+13:10206:x1870854915946368:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1784186561.081895:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+13:10206:x1870854915946368:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 Request processed in 109us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186561.081904:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 135 00000100:00100000:3.0:1784186561.089034:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186561.089532:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915946624 00000100:00100000:0.0:1784186561.089543:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915946624 00000100:00100000:0.0:1784186561.089607:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:0.0:1784186561.089619:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+13:10206:x1870854915946624:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784186561.090434:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+14:10206:x1870854915946624:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 813us (1406us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1784186561.090470:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:3.0:1784186561.318670:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186561.318849:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915946752 00000100:00100000:1.0:1784186561.318860:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915946752 00000100:00100000:1.0:1784186561.318921:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 136 00000100:00100000:1.0:1784186561.318932:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:11015:x1870854915946752:12345-192.168.201.31@tcp:101:lsof.0 00010000:00010000:1.0:1784186561.318954:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186561.318978:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766a1 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186561.319045:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186561.319059:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186561.319071:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186561.319279:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784186561.319290:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784186561.319390:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186561.319417:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a1 expref: 7 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186561.319434:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a1 expref: 6 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186561.319512:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:1.0:1784186561.319515:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784186561.319518:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ede00, rc 0) 00000100:00100000:1.0:1784186561.319580:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:11015:x1870854915946752:12345-192.168.201.31@tcp:101:lsof.0 Request processed in 648us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186561.319588:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 136 00010000:00010000:3.0:1784186561.597854:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186562.621722:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186562.751131:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784186562.751156:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937975040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784186562.751221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186562.751496:0:11527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937975040 00000100:00100000:3.0:1784186562.751504:0:11527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937975040 00000100:00100000:3.0:1784186562.751568:0:11527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784186562.751588:0:11527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937975040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784186562.751633:0:11527:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186562.751680:0:11527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937975040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186562.751827:0:11527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784186562.752103:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937975040:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784186562.754572:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1784186563.303331:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1784186563.303370:0:5806:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1784186563.303520:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1784186563.303531:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1784186563.645911:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186563.773937:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937975552:0@lo:400:kworker.0 00000100:00100000:2.0:1784186563.774025:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186563.774080:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937975424:0@lo:400:kworker.0 00000100:00100000:2.0:1784186563.774116:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937975552 00000100:00100000:0.0:1784186563.774116:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186563.774125:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937975552 00000100:00100000:2.0:1784186563.774202:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784186563.774212:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937975552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186563.774269:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937975552:12345-0@lo:400:kworker.0 Request processed in 58us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186563.774277:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784186563.774321:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937975552:0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.774674:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937975168:0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.774722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186563.774753:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937975680:0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.774774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186563.774791:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784186563.774796:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937975296:0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.774827:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186563.774863:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937975808:0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.774887:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186563.774914:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937975424 00000100:00100000:1.0:1784186563.774919:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937975424 00000100:00100000:1.0:1784186563.774954:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937975680 00000100:00100000:1.0:1784186563.774958:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937975680 00000100:00100000:1.0:1784186563.774971:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937975296 00000100:00100000:1.0:1784186563.774973:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937975296 00000100:00100000:1.0:1784186563.774987:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784186563.774993:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937975424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.775033:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937975424:12345-0@lo:400:kworker.0 Request processed in 39us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186563.775039:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784186563.775057:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784186563.775074:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937975680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.775109:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937975680:12345-0@lo:400:kworker.0 Request processed in 46us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186563.775115:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784186563.775127:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784186563.775133:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937975296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.775159:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937975296:12345-0@lo:400:kworker.0 Request processed in 27us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186563.775165:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784186563.775197:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937975808 00000100:00100000:1.0:1784186563.775201:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937975808 00000100:00100000:1.0:1784186563.775228:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784186563.775234:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937975808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.775273:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937975808:12345-0@lo:400:kworker.0 Request processed in 40us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186563.775280:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1784186563.775297:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186563.775302:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186563.775332:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937975424:0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.775357:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937975296:0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.775366:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937975808:0@lo:400:kworker.0 00000100:00100000:1.0:1784186563.775374:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937975680:0@lo:400:kworker.0 00000100:00100000:2.0:1784186563.775843:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937975168 00000100:00100000:2.0:1784186563.775858:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937975168 00000100:00100000:2.0:1784186563.775895:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1784186563.775903:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937975168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186563.775955:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937975168:12345-0@lo:400:kworker.0 Request processed in 53us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186563.775961:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1784186563.776199:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937975168:0@lo:400:kworker.0 00000100:00100000:1.0:1784186564.285770:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937975936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186564.285852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186564.286018:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937975936 00000100:00100000:0.0:1784186564.286028:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937975936 00000100:00100000:0.0:1784186564.286080:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784186564.286090:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937975936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186564.286142:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186564.286211:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937975936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186564.286218:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784186564.286533:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937975936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784186564.675368:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784186565.292477:0:12197:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:22:43 (1784186563) 00010000:00010000:1.0:1784186565.695749:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186565.972588:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186565.972660:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186565.972698:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186565.972725:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186565.972751:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186565.972783:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915947392 00000100:00100000:2.0:1784186565.972792:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915947392 00000100:00100000:2.0:1784186565.972850:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915947008 00000100:00100000:2.0:1784186565.972853:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915947008 00000100:00100000:2.0:1784186565.972881:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 147 00000100:00100000:2.0:1784186565.972890:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:2354:x1870854915947392:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186565.972965:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:2354:x1870854915947392:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 75us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186565.972973:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 147 00000100:00100000:2.0:1784186565.972993:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 148 00000100:00100000:2.0:1784186565.973001:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+13:2354:x1870854915947008:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186565.973030:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+13:2354:x1870854915947008:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186565.973036:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 148 00000100:00100000:2.0:1784186565.973072:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915947136 00000100:00100000:2.0:1784186565.973076:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915947136 00000100:00100000:2.0:1784186565.973102:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915947264 00000100:00100000:2.0:1784186565.973105:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915947264 00000100:00100000:2.0:1784186565.973125:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:2.0:1784186565.973131:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2354:x1870854915947136:12345-192.168.201.31@tcp:400:kworker.0 00000100:00080000:3.0:1784186565.973136:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784186565.973141:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784186565.973143:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186565.973158:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2354:x1870854915947136:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 27us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186565.973164:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:2.0:1784186565.973175:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 87 00000100:00100000:2.0:1784186565.973181:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915947264:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186565.973202:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915947264:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186565.973208:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 87 00000100:00100000:1.0:1784186565.973289:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915946880 00000100:00100000:1.0:1784186565.973292:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915946880 00000100:00100000:1.0:1784186565.973326:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 291 00000100:00100000:1.0:1784186565.973334:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915946880:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186565.973386:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915946880:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 52us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186565.973393:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 291 00010000:00010000:1.0:1784186566.717798:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186566.857421:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186566.857876:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915947648 00000100:00100000:1.0:1784186566.857901:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915947648 00000100:00100000:1.0:1784186566.857968:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 137 00000100:00100000:1.0:1784186566.857979:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+13:11280:x1870854915947648:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784186566.858001:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186566.858021:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19a41 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766a8 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.858094:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19a48 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.858108:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19a48 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.858120:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19a48 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.858136:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19a4f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.858143:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19a4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.858149:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19a4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.858621:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d19a56 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.858631:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d19a56 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.858638:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d19a56 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186566.858655:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1784186566.859029:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19a48 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859038:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19a48 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859045:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19a48 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859052:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27eca00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186566.859057:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19a48 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859065:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19a48 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859082:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b9fc7718f00) 00010000:00010000:1.0:1784186566.859086:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186566.859092:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19a48 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859101:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19a48 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859116:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19a4f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859123:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19a4f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859139:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19a4f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859146:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186566.859149:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19a4f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859156:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19a4f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859165:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b9fd1d53500) 00010000:00010000:1.0:1784186566.859167:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186566.859170:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19a4f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859175:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19a4f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859628:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19a41 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a8 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859646:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d19a56 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a8 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186566.859653:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:1.0:1784186566.859655:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186566.859658:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ed600, rc 0) 00000100:00100000:1.0:1784186566.859739:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+15:11280:x1870854915947648:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 1761us (2328us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1784186566.859758:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 137 00000100:00100000:3.0:1784186566.865125:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186566.865296:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915947776 00000100:00100000:0.0:1784186566.865305:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915947776 00000100:00100000:0.0:1784186566.865378:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:0.0:1784186566.865388:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe54b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+15:2354:x1870854915947776:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186566.865405:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186566.865432:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d19a56 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a8 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186566.865472:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:0.0:1784186566.865476:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186566.865540:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe54b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+14:2354:x1870854915947776:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 153us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186566.865547:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:3.0:1784186566.872982:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186566.873056:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915947904 00000100:00100000:1.0:1784186566.873066:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915947904 00000100:00100000:1.0:1784186566.873133:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 138 00000100:00100000:1.0:1784186566.873143:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+14:11280:x1870854915947904:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784186566.873263:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+14:11280:x1870854915947904:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 Request processed in 120us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186566.873270:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 138 00000040:00080000:3.0:1784186567.297814:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784186567.297825:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186567.298306:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1784186567.298316:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1784186567.745605:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186567.869806:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186567.869829:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937976064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186567.869899:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186567.869960:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937976064 00000100:00100000:1.0:1784186567.869967:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937976064 00000100:00100000:1.0:1784186567.870020:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784186567.870028:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937976064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784186567.870061:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186567.870099:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937976064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186567.870106:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1784186567.870126:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784186567.870159:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937976064:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1784186568.459528:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:1.0:1784186568.767553:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186568.823993:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186568.824066:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915948032 00000100:00100000:2.0:1784186568.824077:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915948032 00000100:00100000:2.0:1784186568.824147:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 139 00000100:00100000:2.0:1784186568.824157:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+13:11322:x1870854915948032:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186568.824177:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186568.824196:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19a64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766af expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824255:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19a6b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824281:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19a6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824293:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19a6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824308:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a72 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824315:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824322:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824592:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19a6b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824600:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19a6b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824605:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19a6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824611:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766dc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186568.824615:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19a6b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824623:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19a6b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824636:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:2.0:1784186568.824644:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186568.824649:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19a6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824655:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19a6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824668:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a72 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824674:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824680:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824685:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186568.824688:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824695:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a72 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824703:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b9fc5142400) 00010000:00010000:2.0:1784186568.824706:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186568.824709:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824713:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824744:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19a64 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766af expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824766:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:2.0:1784186568.824769:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186568.824772:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19a64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766af expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186568.824783:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d400, rc 0) 00000100:00100000:2.0:1784186568.824839:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+13:11322:x1870854915948032:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 684us (856us total) trans 0 rc 301/301 00000100:00100000:2.0:1784186568.824847:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 139 00000100:00080000:1.0:1784186568.825135:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186568.847784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186568.847825:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915948288 00000100:00100000:1.0:1784186568.847842:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915948288 00000100:00100000:1.0:1784186568.847895:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 140 00000100:00100000:1.0:1784186568.847905:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+13:11322:x1870854915948288:12345-192.168.201.31@tcp:36:lfs.0 00010000:00010000:1.0:1784186568.847958:0:7478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186568.847984:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d193e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764e8 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186568.848003:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:1.0:1784186568.848007:0:7478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784186568.848252:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186568.848266:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a1 expref: 5 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186568.848275:0:7478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186568.848318:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a1 expref: 5 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186568.848332:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a1 expref: 5 pid: 5782 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186568.848347:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec71a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937976192:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186568.848428:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffe21fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784186568.852485:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186568.852526:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915948416 00000100:00100000:3.0:1784186568.852535:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915948416 00000100:00100000:0.0:1784186568.852585:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec71a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937976192:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186568.852591:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a1 expref: 6 pid: 5782 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186568.852615:0:7478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186568.852703:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:3.0:1784186568.852713:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:2357:x1870854915948416:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186568.852728:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186568.852804:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a1 expref: 6 pid: 5782 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.852818:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a1 expref: 6 pid: 5782 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.852839:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19a3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766a1 expref: 6 pid: 5782 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.852852:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:3.0:1784186568.852857:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.852880:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.852888:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.852909:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186568.852959:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2357:x1870854915948416:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 246us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186568.852967:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00080000:3.0:1784186568.852988:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784186568.852998:0:7478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.853004:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.853024:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19a80 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.853034:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19a80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.853040:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19a80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186568.859836:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784186568.859859:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.859870:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.859890:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.859896:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27edc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186568.859901:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.859908:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.859924:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:3.0:1784186568.859927:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186568.859931:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.859937:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19a79 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784186568.859972:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9d7a3c5 reply state 00000000f9b195e0 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19a80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186568.859983:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784186568.860076:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+14:11322:x1870854915948288:12345-192.168.201.31@tcp:36:lfs.0 Request processed in 12168us (12298us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1784186568.860084:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 140 00010000:00010000:1.0:1784186568.862423:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19a80 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186568.862514:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19a80 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186568.862522:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19a80 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186568.862528:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186568.862532:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19a80 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186568.862540:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19a80 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186568.862556:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b9fc7718a00) 00010000:00010000:1.0:1784186568.862559:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186568.862562:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19a80 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186568.862568:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19a80 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186568.894958:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937976576:0@lo:400:kworker.0 00000100:00100000:3.0:1784186568.895037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186568.895087:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186568.895094:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937976704:0@lo:400:kworker.0 00000100:00100000:3.0:1784186568.895140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186568.895178:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937976576 00000100:00100000:3.0:1784186568.895185:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937976576 00000100:00100000:3.0:1784186568.895250:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784186568.895261:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937976576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186568.895318:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937976576:12345-0@lo:400:kworker.0 Request processed in 58us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186568.895326:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784186568.895351:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937976704 00000100:00100000:3.0:1784186568.895354:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937976704 00000100:00100000:3.0:1784186568.895379:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784186568.895386:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937976704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186568.895407:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937976320:0@lo:400:kworker.0 00000100:00100000:3.0:1784186568.895416:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937976704:12345-0@lo:400:kworker.0 Request processed in 31us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186568.895421:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1784186568.895436:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186568.895462:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186568.895487:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937976832:0@lo:400:kworker.0 00000100:00100000:3.0:1784186568.895489:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937976704:0@lo:400:kworker.0 00000100:00100000:3.0:1784186568.895513:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937976576:0@lo:400:kworker.0 00000100:00100000:0.0:1784186568.895522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186568.895543:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937976320 00000100:00100000:3.0:1784186568.895547:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937976320 00000100:00100000:0.0:1784186568.895556:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784186568.895562:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937976448:0@lo:400:kworker.0 00000100:00100000:3.0:1784186568.895570:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1784186568.895575:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937976320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186568.895583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186568.895599:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937976960:0@lo:400:kworker.0 00000100:00100000:3.0:1784186568.895602:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937976320:12345-0@lo:400:kworker.0 Request processed in 27us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186568.895619:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186568.895640:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937976320:0@lo:400:kworker.0 00000100:00100000:0.0:1784186568.895660:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937976960 00000100:00100000:0.0:1784186568.895664:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937976960 00000100:00100000:0.0:1784186568.895696:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784186568.895703:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937976960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186568.895735:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937976960:12345-0@lo:400:kworker.0 Request processed in 34us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186568.895740:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784186568.895763:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937976960:0@lo:400:kworker.0 00000100:00100000:0.0:1784186568.895790:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937976832 00000100:00100000:0.0:1784186568.895794:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937976832 00000100:00100000:0.0:1784186568.895818:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937976448 00000100:00100000:0.0:1784186568.895821:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937976448 00000100:00100000:2.0:1784186568.895824:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784186568.895832:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937976832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186568.895838:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784186568.895842:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937976448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186568.895882:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:3.0:1784186568.895913:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784186568.895923:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784186568.895954:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937976832:12345-0@lo:400:kworker.0 Request processed in 39us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186568.895960:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784186568.899589:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937976448:12345-0@lo:400:kworker.0 Request processed in 3726us (3984us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186568.899611:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784186568.900870:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937976448:0@lo:400:kworker.0 00000100:00100000:2.0:1784186568.900887:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937976832:0@lo:400:kworker.0 00000100:00100000:1.0:1784186568.958968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186568.959824:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915948544 00000100:00100000:3.0:1784186568.959834:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915948544 00000100:00100000:3.0:1784186568.959890:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:3.0:1784186568.959901:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+13:11330:x1870854915948544:12345-192.168.201.31@tcp:101:lctl.0 00010000:00010000:3.0:1784186568.959924:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186568.959947:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19a87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766b6 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.960013:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19a8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.960027:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.960037:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186568.960100:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784186568.960104:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186568.960127:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19a8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.960151:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19a87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766b6 expref: 15 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.960167:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19a8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766b6 expref: 14 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186568.960175:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:3.0:1784186568.960188:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186568.960191:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504c00, rc 0) 00000100:00100000:3.0:1784186568.960265:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+14:11330:x1870854915948544:12345-192.168.201.31@tcp:101:lctl.0 Request processed in 366us (1585us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186568.960274:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 141 00000100:00100000:3.0:1784186569.025504:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186569.025585:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915948672 00000100:00100000:2.0:1784186569.025597:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915948672 00000100:00100000:2.0:1784186569.025668:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00100000:2.0:1784186569.025678:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+14:11336:x1870854915948672:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1784186569.025709:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186569.025959:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19a95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766bd expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026048:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a9c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026062:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026072:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026087:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19aa3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026094:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026101:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026215:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19aaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026223:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026229:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186569.026260:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1784186569.026264:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186569.026288:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026310:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a9c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026317:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a9c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026323:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026330:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186569.026334:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a9c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026341:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a9c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026353:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:2.0:1784186569.026356:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186569.026361:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026366:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19a9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026380:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026386:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19aa3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026391:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026403:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766dc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186569.026406:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026412:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19aa3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026420:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9b9fc5142400) 00010000:00010000:2.0:1784186569.026422:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186569.026425:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19aa3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026431:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19aa3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026523:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19a95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766bd expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026537:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766bd expref: 15 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.026545:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186569.026547:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784186569.026549:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766da00, rc 0) 00000100:00100000:2.0:1784186569.026878:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+15:11336:x1870854915948672:12345-192.168.201.31@tcp:101:bash.0 Request processed in 1200us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186569.026887:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 142 00000100:00100000:1.0:1784186569.036002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.037158:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915948928 00000100:00100000:3.0:1784186569.037172:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915948928 00000100:00100000:3.0:1784186569.037256:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 143 00000100:00100000:3.0:1784186569.037266:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+15:11336:x1870854915948928:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1784186569.037287:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186569.037311:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19ab1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766c4 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.037502:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ab8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.037518:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.037530:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.037864:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19abf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.037874:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.037896:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784186569.038573:0:7478:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1784186569.039214:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.039228:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.039237:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.039273:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ab8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.039280:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ab8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.039288:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ab8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.039294:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186569.039299:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ab8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.039306:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ab8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.039319:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:0.0:1784186569.039322:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186569.039336:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ab8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.039343:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ab8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784186569.039357:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec2f289e reply state 0000000037a9c211 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186569.039366:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784186569.039400:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19ab1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766c4 expref: 18 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.039413:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766c4 expref: 17 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.039419:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fd011a000) 00010000:00010000:0.0:1784186569.039421:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784186569.039423:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fa800, rc 0) 00000100:00100000:0.0:1784186569.039539:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+18:11336:x1870854915948928:12345-192.168.201.31@tcp:101:bash.0 Request processed in 2273us (3547us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1784186569.039548:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 143 00000100:00100000:1.0:1784186569.048039:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186569.048227:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915949056 00000100:00100000:2.0:1784186569.048251:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915949056 00000100:00100000:2.0:1784186569.048331:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:2.0:1784186569.048343:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915949056:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1784186569.048362:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186569.048383:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19ad4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766cb expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784186569.048414:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784186569.048436:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1784186569.048473:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186569.048486:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19ad4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766cb expref: 6 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.048519:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19ad4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766cb expref: 6 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.048534:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d400, rc 0) 00000100:00080000:0.0:1784186569.048713:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784186569.049834:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2356:x1870854915949056:12345-192.168.201.31@tcp:101:bash.0 Request processed in 264us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186569.049849:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 48 00010000:00010000:3.0:1784186569.050195:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.050207:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19abf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.050215:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19abf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.050236:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186569.050242:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19abf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.050250:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19abf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.050267:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fd011ae00) 00010000:00010000:3.0:1784186569.050270:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186569.050275:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19abf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.050281:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19abf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186569.054945:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186569.060375:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915949184 00000100:00100000:0.0:1784186569.060393:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915949184 00000100:00100000:0.0:1784186569.060487:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:0.0:1784186569.060512:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+6:11336:x1870854915949184:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1784186569.060532:0:11903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186569.060553:0:11903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766d2 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.060623:0:11903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19ad4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766cb expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.060632:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186569.060637:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186569.060642:0:11903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 7 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.060682:0:11903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19ad4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766cb expref: 7 pid: 6584 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.060710:0:11903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19ad4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766cb expref: 7 pid: 6584 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186569.060726:0:11903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6f87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11903:1870854937977088:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186569.060836:0:11903:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5416f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784186569.065063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.065158:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915949312 00000100:00100000:3.0:1784186569.065168:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915949312 00010000:00010000:3.0:1784186569.065215:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19ad4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766cb expref: 8 pid: 6584 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186569.065267:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:3.0:1784186569.065278:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2357:x1870854915949312:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186569.065300:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186569.065332:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19ad4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766cb expref: 8 pid: 6584 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.065366:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19ad4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766cb expref: 8 pid: 6584 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.065396:0:5767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186569.065402:0:5767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186569.065413:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 8 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.065425:0:5767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 8 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.065524:0:5767:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 8 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186569.065542:0:5767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5767:1870854937977216:192.168.201.31@tcp:105: 00000100:00100000:3.0:1784186569.065643:0:5767:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503ff00 going to sleep for 11 seconds 00010000:00010000:2.0:1784186569.066793:0:11903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19ad4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766cb expref: 8 pid: 6584 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186569.066816:0:11903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6f87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11903:1870854937977088:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186569.066848:0:11903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 7 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.066879:0:11903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fa400, rc 0) 00000100:00100000:2.0:1784186569.066932:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:11336:x1870854915949184:12345-192.168.201.31@tcp:101:bash.0 Request processed in 6423us (11998us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186569.066941:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:3.0:1784186569.071091:0:5767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5767:1870854937977216:192.168.201.31@tcp:105: 00010000:00010000:3.0:1784186569.071119:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186569.071235:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915949312:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 5957us (6183us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186569.071247:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:1.0:1784186569.075272:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186569.083729:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915949568 00000100:00100000:0.0:1784186569.083819:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915949568 00000100:00100000:1.0:1784186569.089851:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:1.0:1784186569.089867:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+17:11336:x1870854915949568:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:1.0:1784186569.090228:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+18:11336:x1870854915949568:12345-192.168.201.31@tcp:35:bash.0 Request processed in 363us (14966us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1784186569.090249:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:3.0:1784186569.202295:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186569.202386:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915949824 00000100:00100000:1.0:1784186569.202395:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915949824 00000100:00100000:1.0:1784186569.202569:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 144 00000100:00100000:1.0:1784186569.202579:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+18:11346:x1870854915949824:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1784186569.202604:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186569.202625:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19ae2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766d9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186569.202955:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1784186569.203164:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19ae2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d9 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186569.203177:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:1.0:1784186569.203179:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784186569.203182:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19ae2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d9 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186569.203192:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27eda00, rc 0) 00000100:00100000:1.0:1784186569.203282:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+19:11346:x1870854915949824:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 705us (996us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1784186569.203288:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 144 00000100:00100000:0.0:1784186569.211436:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186569.211585:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915950080 00000100:00100000:1.0:1784186569.211595:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915950080 00000100:00100000:1.0:1784186569.211647:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:1.0:1784186569.211657:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+19:11346:x1870854915950080:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1784186569.211923:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+20:11346:x1870854915950080:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 267us (496us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1784186569.211929:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:3.0:1784186569.294788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186569.294930:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915950208 00000100:00100000:0.0:1784186569.294941:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915950208 00000100:00100000:0.0:1784186569.295006:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 145 00000100:00100000:0.0:1784186569.295018:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+20:11352:x1870854915950208:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186569.295055:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186569.295089:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19af0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766e0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.295152:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d19af7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.295166:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d19af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.295180:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d19af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186569.295240:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1784186569.295244:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186569.295268:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d19af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.295295:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19af0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766e0 expref: 22 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.295313:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d19af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766e0 expref: 21 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.295321:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:0.0:1784186569.295324:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784186569.295327:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fac00, rc 0) 00000100:00100000:0.0:1784186569.295403:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+21:11352:x1870854915950208:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 386us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186569.295410:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 145 00000100:00100000:3.0:1784186569.301431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186569.301619:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915950464 00000100:00100000:2.0:1784186569.301629:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915950464 00000100:00100000:2.0:1784186569.301693:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 146 00000100:00100000:2.0:1784186569.301704:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+21:11352:x1870854915950464:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186569.301726:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186569.301748:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19afe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766e7 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.301849:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.301863:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.301876:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186569.301889:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784186569.302039:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19afe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766e7 expref: 24 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.302061:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766e7 expref: 23 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.302082:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fd011a000) 00010000:00010000:2.0:1784186569.302084:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186569.302088:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766dc00, rc 0) 00000100:00100000:2.0:1784186569.302149:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+23:11352:x1870854915950464:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 448us (729us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1784186569.302156:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 146 00000100:00100000:1.0:1784186569.314958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186569.315005:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186569.315047:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915950720 00000100:00100000:0.0:1784186569.315074:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915950720 00000100:00100000:3.0:1784186569.315095:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915950848 00000100:00100000:3.0:1784186569.315101:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915950848 00000100:00100000:0.0:1784186569.315145:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 147 00000100:00100000:0.0:1784186569.315159:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+24:11352:x1870854915950720:12345-192.168.201.31@tcp:101:lfs.0 00000100:00100000:3.0:1784186569.315162:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:3.0:1784186569.315177:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+24:2356:x1870854915950848:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186569.315184:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186569.315191:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186569.315205:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766ee expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.315216:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19b05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766e7 expref: 24 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.315236:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fd011a000) 00010000:00010000:3.0:1784186569.315240:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186569.315292:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+24:2356:x1870854915950848:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 119us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186569.315300:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00010000:00010000:0.0:1784186569.315302:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19b1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.315317:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19b1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.315327:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19b1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186569.315340:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784186569.315518:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766ee expref: 25 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.315533:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19b1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766ee expref: 24 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.315540:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fd011a000) 00010000:00010000:0.0:1784186569.315543:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784186569.315545:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fa200, rc 0) 00000100:00100000:0.0:1784186569.315573:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+24:11352:x1870854915950720:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 419us (625us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1784186569.315580:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 147 00000100:00100000:1.0:1784186569.330386:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186569.330823:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915950976 00000100:00100000:2.0:1784186569.330834:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915950976 00000100:00100000:2.0:1784186569.330906:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:2.0:1784186569.330917:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915950976:12345-192.168.201.31@tcp:1:lfs.0 00010000:00010000:2.0:1784186569.330979:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.331002:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 6 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.331010:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784186569.331015:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186569.331029:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.331067:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 6 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.331081:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 6 pid: 11903 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186569.331111:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6584:1870854937977344:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186569.331216:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc2bb96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186569.339636:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6584:1870854937977344:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186569.339667:0:6584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186569.340011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186569.340668:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915951104 00000100:00100000:2.0:1784186569.340677:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915951104 00002000:00100000:2.0:1784186569.340734:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b9ec71a9880 x1870854915951104/t0(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:25/0 lens 504/0 e 0 to 0 dl 1784186580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186569.340745:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ec71a9880 with x1870854915951104 ext(0->12) 00010000:00010000:2.0:1784186569.340754:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 7 pid: 11903 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.340769:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 7 pid: 11903 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784186569.340777:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b9ec71a9880 00000100:00100000:2.0:1784186569.340806:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:2.0:1784186569.340815:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2356:x1870854915951104:12345-192.168.201.31@tcp:4:lfs.0 00000100:00100000:2.0:1784186569.341368:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2356:x1870854915951104:12345-192.168.201.31@tcp:4:lfs.0 Request processed in 552us (1357us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784186569.341377:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00002000:00100000:2.0:1784186569.341390:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9b9ec71a9880 x1870854915951104/t4294967305(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:25/0 lens 504/448 e 0 to 0 dl 1784186580 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186569.341399:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ec71a9880 with x1870854915951104 ext(0->12) 00010000:00010000:2.0:1784186569.341405:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 9 pid: 11903 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.341418:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 9 pid: 11903 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784186569.341425:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9b9ec71a9880 00000040:00080000:0.0:1784186569.347280:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784186569.347290:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784186569.347857:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1784186569.347866:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784186569.354779:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186569.354865:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915951232 00000100:00100000:2.0:1784186569.354872:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915951232 00010000:00010000:2.0:1784186569.354909:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 9 pid: 11903 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186569.354948:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:2.0:1784186569.354956:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2357:x1870854915951232:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186569.354971:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784186569.354996:0:5769:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784186569.355000:0:5769:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784186569 00002000:00010000:2.0:1784186569.355002:0:5769:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784186569 00002000:00010000:2.0:1784186569.355005:0:5769:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1784186569 00010000:00010000:2.0:1784186569.355011:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 9 pid: 11903 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.355030:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 9 pid: 11903 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.355065:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d19adb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766d2 expref: 9 pid: 11903 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.355081:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186569.355086:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186569.355092:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.355101:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.355132:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186569.355179:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2357:x1870854915951232:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 224us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186569.355186:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 62 00010000:00010000:0.0:1784186569.356215:0:6584:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.356229:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.356257:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.356264:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.356273:0:6584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.356280:0:6584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186569.356285:0:6584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.356293:0:6584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.356324:0:6584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.356332:0:6584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b866618f/0x55bc3e8c99d19b28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186569.356415:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2357:x1870854915950976:12345-192.168.201.31@tcp:1:lfs.0 Request processed in 25498us (26035us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186569.356424:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:0.0:1784186569.360076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186569.360209:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915951488 00000100:00100000:1.0:1784186569.360220:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915951488 00000100:00100000:1.0:1784186569.360279:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:1.0:1784186569.360290:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+24:11352:x1870854915951488:12345-192.168.201.31@tcp:35:lfs.0 00000004:00010000:1.0:1784186569.360364:0:5786:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19b1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766ee expref: 24 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784186569.360824:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1784186569.360869:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1784186569.367850:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1784186569.367962:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.367984:0:5786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766c4 expref: 28 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.367994:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.368159:0:5786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766c4 expref: 28 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.368175:0:5786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766c4 expref: 28 pid: 7478 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186569.368189:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6f86300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5786:1870854937977472:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186569.368290:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5416240 going to sleep for 11 seconds 00000100:00100000:0.0:1784186569.370926:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6f86300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5786:1870854937977472:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186569.370959:0:5786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186569.373369:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.373494:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915951616 00000100:00100000:3.0:1784186569.373505:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915951616 00010000:00010000:3.0:1784186569.373547:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766c4 expref: 29 pid: 7478 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186569.373597:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:3.0:1784186569.373607:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+29:2356:x1870854915951616:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186569.373623:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186569.373632:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766c4 expref: 29 pid: 7478 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.373646:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766c4 expref: 29 pid: 7478 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.373691:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766c4 expref: 29 pid: 7478 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.373706:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fd011a000) 00010000:00010000:3.0:1784186569.373711:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.373720:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.373727:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.373753:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186569.373814:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+28:2356:x1870854915951616:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 207us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186569.373822:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00010000:00010000:0.0:1784186569.373950:0:5786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.373958:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784186569.374099:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1784186569.374294:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1784186569.374404:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6f84e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5786:1870854937977600:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784186569.374503:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186569.374534:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5416780 going to sleep for 11 seconds 00000100:00100000:2.0:1784186569.374672:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937977600 00000100:00100000:2.0:1784186569.374679:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937977600 00000100:00100000:2.0:1784186569.374739:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784186569.374748:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5786:x1870854937977600:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784186569.374825:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5786:x1870854937977600:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186569.374832:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784186569.374872:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6f84e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5786:1870854937977600:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1784186569.375366:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1784186569.375423:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5786:1870854937977728:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784186569.375512:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186569.375540:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937977728 00000100:00100000:2.0:1784186569.375545:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937977728 00000100:00100000:2.0:1784186569.375568:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784186569.375574:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5786:x1870854937977728:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784186569.375725:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5786:x1870854937977728:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 149us (212us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784186569.375732:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784186569.375750:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc2bb9180 going to sleep for 11 seconds 00000100:00100000:2.0:1784186569.375768:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5786:1870854937977728:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1784186569.375807:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1784186569.375840:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.375850:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.375858:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.375864:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186569.375868:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.375875:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.375890:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fd011a000) 00010000:00010000:2.0:1784186569.375893:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784186569.375909:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.375915:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d19b2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784186569.376069:0:5786:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784186569.376166:0:5786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1784186569.376178:0:5786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348097735955ns, next at 349097734127ns, rc = 0 00000001:00080000:2.0:1784186569.376185:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1784186569.376215:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fd011a000) 00010000:00010000:2.0:1784186569.376219:0:5786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784186569.376225:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19b1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766ee expref: 32 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186569.376307:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89bb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+31:11352:x1870854915951488:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 16019us (16242us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1784186569.376315:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 38 00000020:00080000:2.0:1784186569.376318:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1784186569.376535:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784186569.380431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186569.380657:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915951744 00000100:00100000:2.0:1784186569.380669:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915951744 00000100:00100000:2.0:1784186569.380737:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 148 00000100:00100000:2.0:1784186569.380749:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+31:11352:x1870854915951744:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186569.380774:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186569.380797:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766f5 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.380858:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766f5 expref: 32 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.380892:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766f5 expref: 32 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.380915:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186569.380918:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784186569.380922:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d200, rc 0) 00000100:00100000:2.0:1784186569.380987:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+32:11352:x1870854915951744:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 240us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186569.380994:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 148 00000100:00100000:1.0:1784186569.385378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186569.385529:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915952000 00000100:00100000:2.0:1784186569.385540:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915952000 00000100:00100000:2.0:1784186569.385608:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:2.0:1784186569.385618:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+32:11352:x1870854915952000:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1784186569.385866:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+33:11352:x1870854915952000:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 249us (498us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1784186569.385875:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:3.0:1784186569.407162:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784186569.407186:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937977856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784186569.407254:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186569.407690:0:11527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937977856 00000100:00100000:0.0:1784186569.407699:0:11527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937977856 00000100:00100000:0.0:1784186569.407752:0:11527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784186569.407763:0:11527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937977856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186569.407795:0:11527:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186569.407842:0:11527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937977856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186569.407849:0:11527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784186569.408497:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6f86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937977856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186569.478965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.479124:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915952256 00000100:00100000:3.0:1784186569.479134:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915952256 00000100:00100000:3.0:1784186569.479198:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 149 00000100:00100000:3.0:1784186569.479209:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+33:11362:x1870854915952256:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186569.479235:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186569.479271:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19b3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5766fc expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186569.479390:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784186569.479642:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19b3d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766fc expref: 35 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.479658:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:3.0:1784186569.479661:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784186569.479668:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19b3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766fc expref: 35 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.479683:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504800, rc 0) 00000100:00100000:3.0:1784186569.479773:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+34:11362:x1870854915952256:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 565us (817us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1784186569.479781:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 149 00000100:00100000:3.0:1784186569.484178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186569.484342:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915952384 00000100:00100000:2.0:1784186569.484361:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915952384 00000100:00100000:2.0:1784186569.484422:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 150 00000100:00100000:2.0:1784186569.484432:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+34:11362:x1870854915952384:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:2.0:1784186569.484668:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19b4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484686:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19b4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484717:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19b4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484736:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484744:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484751:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484865:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19b59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484874:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484881:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784186569.484929:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484942:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19b4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484948:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19b4b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484955:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19b4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484973:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186569.484978:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19b4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484985:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19b4b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.484998:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186569.485001:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186569.485005:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19b4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485011:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19b4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485159:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485166:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485172:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485176:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186569.485179:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485185:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485203:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186569.485206:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186569.485209:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485215:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485230:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485236:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19b59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485242:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485247:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186569.485250:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485255:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485263:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186569.485265:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186569.485268:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19b59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.485273:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19b59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186569.485707:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+34:11362:x1870854915952384:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 1273us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186569.485718:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 150 00000100:00100000:2.0:1784186569.490010:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.490147:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915952640 00000100:00100000:3.0:1784186569.490160:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915952640 00000100:00100000:3.0:1784186569.490223:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:3.0:1784186569.490235:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+34:11362:x1870854915952640:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186569.490584:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+35:11362:x1870854915952640:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 350us (583us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1784186569.490592:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:0.0:1784186569.524897:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.525004:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915952896 00000100:00100000:3.0:1784186569.525015:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915952896 00000100:00100000:3.0:1784186569.525088:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 151 00000100:00100000:3.0:1784186569.525099:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+35:11365:x1870854915952896:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186569.525131:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186569.525154:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19b60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576703 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525226:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19b67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525241:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19b67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525253:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19b67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525269:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525276:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525283:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525629:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19b75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525639:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525647:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186569.525657:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784186569.525746:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19b67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525753:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19b67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525760:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19b67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525767:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186569.525770:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19b67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525777:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19b67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525789:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:3.0:1784186569.525792:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186569.525796:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19b67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525802:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19b67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525814:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525820:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525825:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525841:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505a00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186569.525844:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525850:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525857:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc7718700) 00010000:00010000:3.0:1784186569.525859:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186569.525861:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525867:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525908:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19b60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576703 expref: 38 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525921:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576703 expref: 37 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.525928:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186569.525930:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186569.525933:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505e00, rc 0) 00000100:00100000:3.0:1784186569.526087:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+37:11365:x1870854915952896:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 989us (1197us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1784186569.526095:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 151 00000100:00100000:1.0:1784186569.529990:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186569.530169:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915953024 00000100:00100000:2.0:1784186569.530181:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915953024 00000100:00100000:2.0:1784186569.530245:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 152 00000100:00100000:2.0:1784186569.530257:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+37:11365:x1870854915953024:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:2.0:1784186569.530327:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.530345:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.530793:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.530822:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.530829:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.530835:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.530841:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186569.530845:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.530872:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.530885:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186569.530888:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784186569.530892:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.530898:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19b83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186569.530974:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+37:11365:x1870854915953024:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 717us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186569.530984:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 152 00000100:00100000:2.0:1784186569.534288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.534372:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915953280 00000100:00100000:3.0:1784186569.534395:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915953280 00000100:00100000:3.0:1784186569.534503:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:3.0:1784186569.534514:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+37:11365:x1870854915953280:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186569.535033:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+38:11365:x1870854915953280:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 518us (754us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1784186569.535042:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 41 00010000:00010000:1.0:1784186569.789701:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186569.804558:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.804714:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915953536 00000100:00100000:3.0:1784186569.804725:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915953536 00000100:00100000:3.0:1784186569.804789:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 153 00000100:00100000:3.0:1784186569.804800:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+38:11396:x1870854915953536:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:3.0:1784186569.804824:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186569.804847:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19b8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57670a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.804949:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.804963:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.804976:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186569.804987:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784186569.805131:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19b8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57670a expref: 41 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.805275:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57670a expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.805304:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186569.805308:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186569.805311:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505a00, rc 0) 00000100:00100000:3.0:1784186569.805382:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+40:11396:x1870854915953536:12345-192.168.201.31@tcp:101:cat.0 Request processed in 584us (833us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1784186569.805390:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 153 00000100:00100000:1.0:1784186569.809263:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.809338:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915953792 00000100:00100000:3.0:1784186569.809360:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915953792 00000100:00100000:3.0:1784186569.809438:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:3.0:1784186569.809494:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+40:11396:x1870854915953792:12345-192.168.201.31@tcp:35:cat.0 00000100:00100000:3.0:1784186569.809731:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+41:11396:x1870854915953792:12345-192.168.201.31@tcp:35:cat.0 Request processed in 240us (479us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1784186569.809737:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:2.0:1784186569.811098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186569.811306:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915953920 00000100:00100000:0.0:1784186569.811314:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915953920 00000100:00100000:0.0:1784186569.811505:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:0.0:1784186569.811518:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+41:2357:x1870854915953920:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186569.811536:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186569.811573:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19b91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57670a expref: 41 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.811594:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:0.0:1784186569.811599:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186569.811743:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+40:2357:x1870854915953920:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 227us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186569.811752:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:1.0:1784186569.869259:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.869536:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915954176 00000100:00100000:3.0:1784186569.869547:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915954176 00000100:00100000:3.0:1784186569.869668:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 154 00000100:00100000:3.0:1784186569.869679:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+40:11402:x1870854915954176:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:3.0:1784186569.869707:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186569.869711:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784186569.869743:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d19af7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766e0 expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.869764:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:3.0:1784186569.869770:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186569.869783:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19b9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576711 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.869934:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.869950:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19b75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576703 expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.869959:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.869998:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576703 expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.870013:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19b75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576703 expref: 40 pid: 5784 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186569.870028:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc11500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937977984:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186569.870261:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f600 going to sleep for 11 seconds 00000100:00100000:1.0:1784186569.874067:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.874181:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc11500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937977984:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186569.874212:0:5782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186569.874484:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915954304 00000100:00100000:0.0:1784186569.874492:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915954304 00010000:00010000:0.0:1784186569.874530:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19b75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576703 expref: 41 pid: 5784 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186569.874677:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:0.0:1784186569.874687:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe54bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+41:2357:x1870854915954304:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186569.874704:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186569.874710:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19b75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576703 expref: 41 pid: 5784 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.874722:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576703 expref: 41 pid: 5784 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.874760:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19b75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576703 expref: 41 pid: 5784 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.874775:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:0.0:1784186569.874780:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.874789:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.874796:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186569.874819:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186569.874958:0:5782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.874966:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186569.874986:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784186569.875150:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19b9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576711 expref: 42 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.875167:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576711 expref: 41 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.875174:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186569.875177:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784186569.875179:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504400, rc 0) 00000100:00100000:0.0:1784186569.875286:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe54bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+41:2357:x1870854915954304:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 599us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186569.875295:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:3.0:1784186569.875763:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+40:11402:x1870854915954176:12345-192.168.201.31@tcp:101:dd.0 Request processed in 6084us (6514us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1784186569.875771:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 154 00000100:00100000:1.0:1784186569.878714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186569.878801:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915954560 00000100:00100000:3.0:1784186569.878811:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915954560 00000100:00100000:3.0:1784186569.878888:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 155 00000100:00100000:3.0:1784186569.878898:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+40:11402:x1870854915954560:12345-192.168.201.31@tcp:36:dd.0 00010000:00010000:3.0:1784186569.879169:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19bb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.879185:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186569.879196:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784186569.879244:0:7478:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1784186569.879267:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c2db4dd reply state 0000000089e7b1d6 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186569.879275:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784186569.879577:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+43:11402:x1870854915954560:12345-192.168.201.31@tcp:36:dd.0 Request processed in 679us (871us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1784186569.879585:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 155 00000020:00080000:3.0:1784186569.879589:0:7478:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784186569.890649:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.890667:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19bb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.890675:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.890681:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505c00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186569.890686:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.890693:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19bb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.890729:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186569.890732:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186569.890738:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19bb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186569.890744:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19bb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186570.211160:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186570.211268:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915954688 00000100:00100000:2.0:1784186570.211279:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915954688 00000100:00100000:2.0:1784186570.211369:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 156 00000100:00100000:2.0:1784186570.211380:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+42:11416:x1870854915954688:12345-192.168.201.31@tcp:101:stat.0 00010000:00010000:2.0:1784186570.211406:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186570.211737:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19bbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576718 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.211811:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19bc2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.211828:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.211839:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.211853:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19bc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.211860:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.211884:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.212067:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.212080:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576711 expref: 43 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.212089:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.212125:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576711 expref: 43 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.212139:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576711 expref: 43 pid: 5782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186570.212152:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937978112:192.168.201.31@tcp:104: 00000100:00080000:0.0:1784186570.212331:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186570.213120:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc2bb9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784186570.220715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186570.220828:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937978112:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186570.220854:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186570.226160:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915954944 00000100:00100000:3.0:1784186570.226183:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915954944 00000100:00100000:3.0:1784186570.226264:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:3.0:1784186570.226276:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+44:5569:x1870854915954944:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784186570.227086:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+45:5569:x1870854915954944:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 807us (6377us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1784186570.227096:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:1.0:1784186570.231293:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186570.231815:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915955072 00000100:00100000:3.0:1784186570.231824:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915955072 00010000:00010000:3.0:1784186570.231865:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576711 expref: 45 pid: 5782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186570.231894:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:3.0:1784186570.231902:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+45:2356:x1870854915955072:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186570.231918:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186570.231924:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576711 expref: 45 pid: 5782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.231938:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576711 expref: 45 pid: 5782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.231960:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19ba6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576711 expref: 45 pid: 5782 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.231988:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186570.231993:0:5767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.232003:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.232011:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.232040:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186570.232096:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+44:2356:x1870854915955072:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 193us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186570.232104:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 65 00010000:00010000:2.0:1784186570.232173:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232182:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186570.232236:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784186570.232240:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186570.232263:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232276:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232286:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19bc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232292:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19bc2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232298:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232303:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186570.232319:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19bc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232326:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19bc2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232335:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186570.232338:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186570.232341:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19bc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232346:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19bc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232364:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232370:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232375:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232380:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766ce00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186570.232383:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232388:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232396:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186570.232398:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186570.232400:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19bc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232406:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19bc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232773:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19bbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576718 expref: 44 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232792:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576718 expref: 43 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.232810:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186570.232813:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186570.232815:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766de00, rc 0) 00000100:00100000:2.0:1784186570.232850:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+43:11416:x1870854915954688:12345-192.168.201.31@tcp:101:stat.0 Request processed in 21473us (21701us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186570.232857:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 156 00000100:00100000:1.0:1784186570.314335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186570.314524:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915955328 00000100:00100000:0.0:1784186570.314536:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915955328 00000100:00100000:0.0:1784186570.314608:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 157 00000100:00100000:0.0:1784186570.314618:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+43:11422:x1870854915955328:12345-192.168.201.31@tcp:36:truncate.0 00010000:00010000:0.0:1784186570.314691:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186570.314726:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19bd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576718 expref: 43 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.314748:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:0.0:1784186570.314766:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784186570.314986:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19bd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.315000:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.315011:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784186570.315065:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1784186570.315092:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000375a4cbe reply state 000000005a0add25 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186570.315101:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784186570.315209:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+45:11422:x1870854915955328:12345-192.168.201.31@tcp:36:truncate.0 Request processed in 591us (899us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1784186570.315216:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 157 00000020:00080000:0.0:1784186570.315222:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784186570.318118:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.318136:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19bd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.318145:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.318151:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186570.318156:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.318165:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19bd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.318204:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186570.318206:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186570.318211:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19bd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.318217:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19bd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186570.500293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186570.500477:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915955456 00000100:00100000:3.0:1784186570.500488:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915955456 00000100:00100000:3.0:1784186570.500550:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 158 00000100:00100000:3.0:1784186570.500560:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+44:11436:x1870854915955456:12345-192.168.201.31@tcp:101:stat.0 00010000:00010000:3.0:1784186570.500594:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186570.500619:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19bde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57671f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.500831:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19be5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.500847:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19be5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.500859:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19be5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.500875:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19bec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.500883:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.500910:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501148:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501164:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501172:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186570.501207:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1784186570.501211:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186570.501234:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501248:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501255:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19be5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501261:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19be5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501268:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19be5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501274:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186570.501279:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19be5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501292:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19be5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501305:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:3.0:1784186570.501308:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186570.501313:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19be5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501318:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19be5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501331:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19bec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501337:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19bec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501342:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501348:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186570.501351:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19bec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501357:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19bec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501364:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc7718700) 00010000:00010000:3.0:1784186570.501366:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186570.501369:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19bec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501385:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19bec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501421:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19bde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57671f expref: 46 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501436:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57671f expref: 45 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.501583:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186570.501585:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186570.501588:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505600, rc 0) 00000100:00100000:3.0:1784186570.501774:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+45:11436:x1870854915955456:12345-192.168.201.31@tcp:101:stat.0 Request processed in 1213us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186570.501782:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 158 00000100:00100000:1.0:1784186570.590431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186570.590524:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915955712 00000100:00100000:0.0:1784186570.590536:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915955712 00000100:00100000:0.0:1784186570.590704:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 159 00000100:00100000:0.0:1784186570.590715:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+45:11447:x1870854915955712:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186570.590737:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186570.590759:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19bfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576726 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186570.590894:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1784186570.591021:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19bfa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576726 expref: 47 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.591054:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:0.0:1784186570.591057:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784186570.591063:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19bfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576726 expref: 47 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.591077:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fbe00, rc 0) 00000100:00100000:0.0:1784186570.591140:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+46:11447:x1870854915955712:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 428us (731us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1784186570.591146:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 159 00000100:00100000:1.0:1784186570.595197:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186570.595251:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915955968 00000100:00100000:0.0:1784186570.595261:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915955968 00000100:00100000:0.0:1784186570.595365:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:0.0:1784186570.595376:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+46:11447:x1870854915955968:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:0.0:1784186570.595891:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+47:11447:x1870854915955968:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 514us (702us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1784186570.595901:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:1.0:1784186570.667775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186570.667890:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915956224 00000100:00100000:2.0:1784186570.667904:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915956224 00000100:00100000:2.0:1784186570.668081:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 160 00000100:00100000:2.0:1784186570.668092:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+47:11453:x1870854915956224:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1784186570.668119:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186570.668142:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19c08 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57672d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.668252:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.668267:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57671f expref: 48 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.668276:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.668311:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57671f expref: 48 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.668326:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57671f expref: 48 pid: 5782 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186570.668357:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937978240:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186570.668518:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc2bb9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186570.674290:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937978240:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186570.674321:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186570.674716:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186570.674893:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915956352 00000100:00100000:2.0:1784186570.674899:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915956352 00010000:00010000:2.0:1784186570.674942:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57671f expref: 49 pid: 5782 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186570.674970:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:2.0:1784186570.674976:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+49:2357:x1870854915956352:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186570.674988:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186570.674994:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57671f expref: 49 pid: 5782 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.675001:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57671f expref: 49 pid: 5782 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.675018:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19bf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57671f expref: 49 pid: 5782 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.675030:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186570.675033:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.675050:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.675056:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.675078:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186570.675121:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+48:2357:x1870854915956352:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 145us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186570.675126:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 66 00010000:00010000:1.0:1784186570.675629:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186570.675638:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186570.675661:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1784186570.675824:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19c08 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57672d expref: 49 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186570.675842:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57672d expref: 48 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186570.675849:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:1.0:1784186570.675852:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784186570.675854:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766ce00, rc 0) 00000100:00100000:1.0:1784186570.676046:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+48:11453:x1870854915956224:12345-192.168.201.31@tcp:101:bash.0 Request processed in 7954us (8281us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1784186570.676054:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 160 00000100:00100000:1.0:1784186570.681909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186570.682631:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915956608 00000100:00100000:3.0:1784186570.682641:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915956608 00000100:00100000:3.0:1784186570.682692:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 161 00000100:00100000:3.0:1784186570.682700:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+48:11453:x1870854915956608:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:3.0:1784186570.682937:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.682951:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.682959:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784186570.683011:0:7478:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1784186570.683027:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5e253db reply state 00000000ccbcecd9 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186570.683033:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784186570.683106:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+51:11453:x1870854915956608:12345-192.168.201.31@tcp:36:bash.0 Request processed in 407us (1205us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1784186570.683111:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 161 00000020:00080000:3.0:1784186570.683115:0:7478:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784186570.687652:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.687669:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.687677:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.687683:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186570.687688:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.687696:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.687713:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186570.687716:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186570.687720:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.687748:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186570.695320:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186570.695632:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915956736 00000100:00100000:3.0:1784186570.695645:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915956736 00000100:00100000:3.0:1784186570.695704:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:3.0:1784186570.695712:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+50:11453:x1870854915956736:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1784186570.695733:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186570.695750:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576734 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.695834:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.695849:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57672d expref: 51 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.695859:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19c2b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.695891:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57672d expref: 51 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.696197:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57672d expref: 51 pid: 5783 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186570.696209:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fccc11500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937978368:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186570.696358:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784186570.698880:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fccc11500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937978368:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186570.699015:0:5782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186570.699480:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186570.699734:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915956864 00000100:00100000:3.0:1784186570.699743:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915956864 00010000:00010000:3.0:1784186570.699784:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57672d expref: 52 pid: 5783 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186570.699878:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:3.0:1784186570.699890:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe241880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+52:2357:x1870854915956864:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186570.699923:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186570.699931:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57672d expref: 52 pid: 5783 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.699944:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57672d expref: 52 pid: 5783 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.699970:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19c0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57672d expref: 52 pid: 5783 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.700009:0:5767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186570.700015:0:5767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.700023:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.700032:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19c2b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.700064:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186570.700126:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe241880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+51:2357:x1870854915956864:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 237us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186570.700134:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00010000:00010000:2.0:1784186570.700521:0:5782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.700532:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186570.700596:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784186570.700605:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186570.700628:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.700663:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576734 expref: 51 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.700679:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576734 expref: 50 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.700686:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186570.700689:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186570.700691:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504800, rc 0) 00000100:00100000:2.0:1784186570.700733:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe243800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+50:11453:x1870854915956736:12345-192.168.201.31@tcp:101:bash.0 Request processed in 5021us (5424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186570.700739:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:1.0:1784186570.704588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186570.704675:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915957120 00000100:00100000:3.0:1784186570.704683:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915957120 00000100:00100000:3.0:1784186570.704728:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:3.0:1784186570.704734:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+50:11453:x1870854915957120:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:3.0:1784186570.704956:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+51:11453:x1870854915957120:12345-192.168.201.31@tcp:35:bash.0 Request processed in 219us (373us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1784186570.704964:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:1.0:1784186570.759718:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186570.759930:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915957376 00000100:00100000:3.0:1784186570.759942:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915957376 00000100:00100000:3.0:1784186570.760067:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 163 00000100:00100000:3.0:1784186570.760079:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+51:11463:x1870854915957376:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186570.760111:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186570.760163:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57673b expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186570.760329:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784186570.760526:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c32 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57673b expref: 53 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.760550:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:3.0:1784186570.760554:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784186570.760559:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57673b expref: 53 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.760575:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504600, rc 0) 00000100:00100000:3.0:1784186570.760645:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe240a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+52:11463:x1870854915957376:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 568us (937us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1784186570.760652:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 163 00000100:00100000:1.0:1784186570.767276:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186570.769914:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915957504 00000100:00100000:2.0:1784186570.769930:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915957504 00000100:00100000:2.0:1784186570.770057:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 164 00000100:00100000:2.0:1784186570.770080:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+52:11463:x1870854915957504:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:2.0:1784186570.770157:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19c40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770173:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770184:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770197:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19c47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770204:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770210:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770704:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770715:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770723:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784186570.770836:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770850:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19c40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770866:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19c40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770873:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19c40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770879:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186570.770884:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19c40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770891:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19c40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770904:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186570.770908:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186570.770912:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19c40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770919:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19c40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770933:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770938:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19c47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770943:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770947:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186570.770956:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770962:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19c47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770970:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186570.770972:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186570.770975:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19c47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770980:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19c47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.770996:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.771001:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19c4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.771006:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.771010:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766cc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186570.771013:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.771018:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19c4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.771025:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186570.771027:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186570.771036:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19c4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.771041:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19c4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186570.771126:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe242d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+52:11463:x1870854915957504:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 1044us (3857us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186570.771136:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 164 00000100:00100000:1.0:1784186570.773817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186570.773957:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915957760 00000100:00100000:3.0:1784186570.773967:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915957760 00000100:00100000:3.0:1784186570.774029:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:3.0:1784186570.774039:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+52:11463:x1870854915957760:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186570.774277:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe243480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+53:11463:x1870854915957760:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 237us (467us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1784186570.774284:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 46 00010000:00010000:3.0:1784186570.814003:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186570.828061:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186570.829004:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915958016 00000100:00100000:0.0:1784186570.829016:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915958016 00000100:00100000:0.0:1784186570.829128:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:0.0:1784186570.829138:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+53:11466:x1870854915958016:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186570.829184:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186570.829205:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d19c55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576742 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829280:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19c5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829323:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19c5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829335:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19c5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829357:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19c63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829364:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829370:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829544:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d19c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829554:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d19c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829561:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d19c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186570.829570:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784186570.829669:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19c5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829677:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19c5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829684:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19c5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829696:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fbe00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186570.829700:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19c5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829708:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19c5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829719:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:0.0:1784186570.829722:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186570.829727:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19c5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829733:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d19c5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829744:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829750:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19c63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829756:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829761:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186570.829769:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829774:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19c63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829790:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fd011a700) 00010000:00010000:0.0:1784186570.829792:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186570.829795:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19c63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829801:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d19c63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829837:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d19c55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576742 expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829848:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d19c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576742 expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186570.829855:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:0.0:1784186570.829858:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784186570.829860:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fac00, rc 0) 00000100:00100000:0.0:1784186570.829915:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe243100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+55:11466:x1870854915958016:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 780us (1864us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1784186570.829923:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 165 00000100:00100000:1.0:1784186570.835249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186570.835332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186570.835413:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915958272 00000100:00100000:3.0:1784186570.835423:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915958272 00000100:00100000:3.0:1784186570.835522:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:3.0:1784186570.835532:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+55:11466:x1870854915958272:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:3.0:1784186570.835837:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.835856:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.835869:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.835898:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.835906:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.835913:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.835920:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186570.835924:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.835931:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.835942:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186570.835945:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784186570.835950:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186570.835957:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186570.836049:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+55:11466:x1870854915958272:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 518us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186570.836058:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:2.0:1784186570.838153:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915958144 00000100:00100000:2.0:1784186570.838166:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915958144 00000100:00100000:2.0:1784186570.838238:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:2.0:1784186570.838248:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+55:2356:x1870854915958144:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186570.838264:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186570.838292:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d19c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576742 expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186570.838321:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186570.838326:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186570.838380:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe241180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+54:2356:x1870854915958144:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 133us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186570.838387:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:1.0:1784186570.840835:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186570.841072:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915958528 00000100:00100000:3.0:1784186570.841081:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915958528 00000100:00100000:3.0:1784186570.841133:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:3.0:1784186570.841144:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+54:11466:x1870854915958528:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186570.841374:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+55:11466:x1870854915958528:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 231us (548us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1784186570.841382:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:1.0:1784186571.024930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.025027:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915958784 00000100:00100000:3.0:1784186571.025038:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915958784 00000100:00100000:3.0:1784186571.025101:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 167 00000100:00100000:3.0:1784186571.025111:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+55:11484:x1870854915958784:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:3.0:1784186571.025135:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186571.025158:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576749 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.025265:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.025280:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.025290:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186571.025318:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784186571.025831:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576749 expref: 58 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.025853:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576749 expref: 57 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.025862:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:3.0:1784186571.025865:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784186571.025870:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504400, rc 0) 00000100:00100000:3.0:1784186571.025993:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+57:11484:x1870854915958784:12345-192.168.201.31@tcp:101:cat.0 Request processed in 881us (1072us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1784186571.026009:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 167 00000100:00100000:0.0:1784186571.083968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.084251:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915958912 00000100:00100000:3.0:1784186571.084265:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915958912 00000100:00100000:3.0:1784186571.084339:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 168 00000100:00100000:3.0:1784186571.084363:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+57:11485:x1870854915958912:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186571.084403:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186571.084429:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576750 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.084566:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19c9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.084582:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.084629:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186571.084697:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1784186571.084701:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186571.084724:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.084756:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19c94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576750 expref: 59 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.084776:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576750 expref: 58 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.084783:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:3.0:1784186571.084786:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186571.084790:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505600, rc 0) 00000100:00100000:3.0:1784186571.084861:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+58:11485:x1870854915958912:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 513us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186571.084870:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 168 00000100:00100000:1.0:1784186571.094123:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186571.094164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186571.094200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186571.094243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186571.094278:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915959424 00000100:00100000:1.0:1784186571.094287:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915959424 00000100:00100000:1.0:1784186571.094350:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 152 00000100:00100000:1.0:1784186571.094362:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915959424:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186571.094524:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915959424:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 164us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186571.094545:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 152 00000100:00100000:0.0:1784186571.094908:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915959296 00000100:00100000:0.0:1784186571.094914:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915959296 00000100:00100000:0.0:1784186571.094949:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915959168 00000100:00100000:0.0:1784186571.094953:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915959168 00000100:00100000:0.0:1784186571.094976:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 90 00000100:00100000:0.0:1784186571.094984:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915959296:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186571.095033:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe240e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2354:x1870854915959296:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 50us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186571.095040:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 90 00000100:00100000:0.0:1784186571.095053:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 91 00000100:00100000:0.0:1784186571.095059:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915959168:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186571.095079:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915959168:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 21us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186571.095085:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 91 00000100:00080000:0.0:1784186571.095100:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784186571.095104:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784186571.095106:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186571.095836:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915959040 00000100:00100000:2.0:1784186571.095844:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915959040 00000100:00100000:2.0:1784186571.095910:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 293 00000100:00100000:2.0:1784186571.095920:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915959040:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186571.095986:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915959040:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 68us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186571.096010:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 293 00000100:00100000:1.0:1784186571.105617:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.105807:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915959808 00000100:00100000:3.0:1784186571.105817:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915959808 00000100:00100000:3.0:1784186571.105975:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:3.0:1784186571.105986:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+58:11485:x1870854915959808:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186571.106590:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11485:x1870854915959808:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 604us (990us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1784186571.106610:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:1.0:1784186571.110213:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186571.110296:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915959936 00000100:00100000:0.0:1784186571.110314:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915959936 00000100:00100000:0.0:1784186571.110377:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:0.0:1784186571.110387:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11485:x1870854915959936:12345-192.168.201.31@tcp:103:lfs.0 00010000:00010000:0.0:1784186571.110411:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784186571.110476:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576734 expref: 59 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.110502:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576749 expref: 58 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.110514:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766f5 expref: 57 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.110526:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:0.0:1784186571.110758:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186571.110819:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+56:11485:x1870854915959936:12345-192.168.201.31@tcp:103:lfs.0 Request processed in 433us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186571.110827:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:0.0:1784186571.113997:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.114100:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915960064 00000100:00100000:3.0:1784186571.114113:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915960064 00000100:00100000:3.0:1784186571.114180:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 169 00000100:00100000:3.0:1784186571.114192:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+56:11485:x1870854915960064:12345-192.168.201.31@tcp:58:lfs.0 00010000:00010000:3.0:1784186571.114313:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19ca2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.114329:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19ca2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.114340:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19ca2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784186571.114691:0:5782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1784186571.114790:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+56:11485:x1870854915960064:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 598us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186571.114800:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 169 00000100:00100000:1.0:1784186571.143621:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.143763:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915960192 00000100:00100000:3.0:1784186571.143775:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915960192 00000100:00100000:3.0:1784186571.143841:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 170 00000100:00100000:3.0:1784186571.143851:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+56:11487:x1870854915960192:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186571.143873:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186571.143895:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ca9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576757 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.143985:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19cb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144013:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144026:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144042:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19cb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144056:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144063:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144175:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144184:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144191:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186571.144230:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784186571.144235:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186571.144255:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144266:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144274:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144281:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19cb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144288:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144304:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505e00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186571.144308:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144316:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144328:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:3.0:1784186571.144331:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186571.144337:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19cb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144343:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19cb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144356:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144361:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19cb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144367:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144372:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505a00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186571.144375:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144380:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144402:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc7718900) 00010000:00010000:3.0:1784186571.144405:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186571.144407:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19cb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144413:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19cb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144517:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19ca9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576757 expref: 58 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144534:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576757 expref: 57 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.144541:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718700) 00010000:00010000:3.0:1784186571.144544:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186571.144547:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504400, rc 0) 00000100:00100000:3.0:1784186571.145377:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe240700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+57:11487:x1870854915960192:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1520us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186571.145388:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 170 00000040:00080000:0.0:1784186571.389860:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784186571.389872:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784186571.389970:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784186571.389978:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784186571.390110:0:11521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6f86300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937978496:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784186571.390613:0:11521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5416d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784186571.404002:0:11521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6f86300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937978496:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784186571.417792:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.417997:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915960320 00000100:00100000:3.0:1784186571.418008:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915960320 00000100:00100000:3.0:1784186571.418076:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 171 00000100:00100000:3.0:1784186571.418088:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+57:11498:x1870854915960320:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784186571.418126:0:5783:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784186571.418244:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+57:11498:x1870854915960320:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 159us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186571.418267:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 171 00000100:00100000:2.0:1784186571.433719:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186571.433831:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915960448 00000100:00100000:0.0:1784186571.433840:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915960448 00000100:00100000:0.0:1784186571.433901:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 172 00000100:00100000:0.0:1784186571.433911:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+57:11498:x1870854915960448:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784186571.433986:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19cc5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434003:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434017:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434032:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19ccc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434050:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19ccc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434057:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19ccc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434085:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19cd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434093:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434098:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186571.434132:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1784186571.434135:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186571.434147:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434158:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434164:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19cc5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434171:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434177:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186571.434181:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434194:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19cc5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434206:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:0.0:1784186571.434209:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186571.434213:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19cc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434220:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19cc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434230:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19ccc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434236:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19ccc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434241:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19ccc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434247:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186571.434249:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19ccc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434255:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19ccc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434261:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9b9fd011a700) 00010000:00010000:0.0:1784186571.434264:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186571.434266:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19ccc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434280:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19ccc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434295:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434301:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434306:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434311:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186571.434313:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434319:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434325:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718700) 00010000:00010000:0.0:1784186571.434328:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186571.434330:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19cd3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.434336:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19cd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186571.434412:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+57:11498:x1870854915960448:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 Request processed in 501us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186571.434419:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 172 00000100:00100000:2.0:1784186571.436961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186571.437028:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915960704 00000100:00100000:0.0:1784186571.437038:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915960704 00000100:00100000:0.0:1784186571.437103:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 173 00000100:00100000:0.0:1784186571.437114:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+57:11498:x1870854915960704:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784186571.437134:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186571.437155:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19cda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57675e expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437255:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19ce1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437269:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437280:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186571.437293:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784186571.437399:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19ce1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437407:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19ce1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437413:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437420:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58faa00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186571.437424:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437431:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19ce1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437519:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718700) 00010000:00010000:0.0:1784186571.437522:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784186571.437527:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19ce1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437534:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19ce1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437582:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19cda lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57675e expref: 59 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437593:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:0.0:1784186571.437596:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784186571.437600:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19cda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57675e expref: 59 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.437611:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fa600, rc 0) 00000100:00100000:0.0:1784186571.437668:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+58:11498:x1870854915960704:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 556us (716us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1784186571.437676:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 173 00000100:00100000:3.0:1784186571.447715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186571.447796:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915960832 00000100:00100000:0.0:1784186571.447807:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915960832 00000100:00100000:0.0:1784186571.447868:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 174 00000100:00100000:0.0:1784186571.447878:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+58:11498:x1870854915960832:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784186571.447915:0:5784:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784186571.448025:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+58:11498:x1870854915960832:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 147us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186571.448048:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 174 00000100:00100000:1.0:1784186571.470849:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186571.470949:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915961088 00000100:00100000:0.0:1784186571.470960:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915961088 00000100:00100000:0.0:1784186571.471018:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 175 00000100:00100000:0.0:1784186571.471031:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+58:11498:x1870854915961088:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784186571.471055:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186571.471058:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784186571.471090:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19c9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576750 expref: 58 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.471111:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:0.0:1784186571.471115:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784186571.471133:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19cef lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576765 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784186571.471797:0:5782:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1784186571.472022:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.472037:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.472047:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.472104:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19cef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576765 expref: 60 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.472141:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576765 expref: 59 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.472148:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fd011a700) 00010000:00010000:0.0:1784186571.472151:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784186571.472154:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58faa00, rc 0) 00000100:00100000:0.0:1784186571.472218:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11498:x1870854915961088:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 1190us (1381us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1784186571.472226:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 175 00000100:00100000:1.0:1784186571.485515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186571.485737:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915961344 00000100:00100000:2.0:1784186571.485747:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915961344 00000100:00100000:2.0:1784186571.485802:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 176 00000100:00100000:2.0:1784186571.485813:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11498:x1870854915961344:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784186571.485873:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186571.485900:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58faa00/0x55bc3e8c99d19cf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576765 expref: 59 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.485916:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fd011a700) 00010000:00010000:2.0:1784186571.485928:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186571.485949:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.485963:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.485972:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.485987:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1eede565 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486004:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1eede565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486012:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1eede565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486083:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486090:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486097:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486102:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186571.486112:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486119:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486128:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186571.486131:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186571.486135:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486140:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486151:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1eede565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486163:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1eede565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486168:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1eede565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486173:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186571.486175:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1eede565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486181:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1eede565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486188:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1eede565 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186571.486190:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186571.486192:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1eede565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.486197:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1eede565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186571.486281:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+58:11498:x1870854915961344:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 469us (785us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784186571.486288:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 176 00000100:00100000:2.0:1784186571.489046:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.489117:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915961472 00000100:00100000:3.0:1784186571.489127:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915961472 00000100:00100000:3.0:1784186571.489176:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 177 00000100:00100000:3.0:1784186571.489184:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+58:11498:x1870854915961472:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186571.489203:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186571.489225:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19d12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57676c expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.489257:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19d19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.489270:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.489280:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.489387:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57676c expref: 60 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.489407:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57676c expref: 59 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.489416:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fc7718900) 00010000:00010000:3.0:1784186571.489419:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784186571.489422:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505a00, rc 0) 00000100:00100000:3.0:1784186571.489633:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11498:x1870854915961472:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 448us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186571.489640:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 177 00000100:00100000:3.0:1784186571.492990:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186571.493171:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915961728 00000100:00100000:2.0:1784186571.493180:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915961728 00000100:00100000:2.0:1784186571.493232:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 178 00000100:00100000:2.0:1784186571.493241:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11498:x1870854915961728:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784186571.493348:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19d20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.493367:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.493379:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784186571.493718:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1784186571.493729:0:5784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350215286032ns, next at 351215283568ns, rc = 0 00000004:00010000:2.0:1784186571.493817:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000011afa8f9 reply state 0000000011e666b8 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186571.493827:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186571.493926:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+61:11498:x1870854915961728:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 684us (946us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1784186571.493935:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 178 00000100:00100000:2.0:1784186571.497482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186571.497522:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915961856 00000100:00100000:2.0:1784186571.497537:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915961856 00000100:00100000:2.0:1784186571.497594:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 179 00000100:00100000:2.0:1784186571.497605:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+61:11498:x1870854915961856:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186571.497629:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186571.497650:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19d27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576773 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.497708:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19d27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576773 expref: 62 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.497739:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19d27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576773 expref: 62 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.497760:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fc7718900) 00010000:00010000:2.0:1784186571.497764:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784186571.497767:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d800, rc 0) 00000100:00100000:2.0:1784186571.497822:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+62:11498:x1870854915961856:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 220us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186571.497831:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 179 00010000:00010000:3.0:1784186571.498244:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19d20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.498253:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19d20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.498260:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19d20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.498265:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766dc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186571.498270:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19d20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.498278:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19d20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.498289:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fc7718900) 00010000:00010000:3.0:1784186571.498291:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784186571.498295:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19d20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.498301:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19d20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186571.506815:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186571.507332:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915961984 00000100:00100000:1.0:1784186571.507342:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915961984 00000100:00100000:1.0:1784186571.507405:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:1.0:1784186571.507417:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+6:2357:x1870854915961984:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784186571.507956:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2357:x1870854915961984:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 540us (1146us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1784186571.507965:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:2.0:1784186571.510934:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.511009:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915962240 00000100:00100000:3.0:1784186571.511019:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915962240 00000100:00100000:3.0:1784186571.511084:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:3.0:1784186571.511094:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+61:11498:x1870854915962240:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784186571.511338:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+62:11498:x1870854915962240:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 244us (412us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1784186571.511346:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:1.0:1784186571.513907:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186571.513983:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915962496 00000100:00100000:2.0:1784186571.513992:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915962496 00000100:00100000:2.0:1784186571.514047:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 180 00000100:00100000:2.0:1784186571.514057:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+62:11498:x1870854915962496:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784186571.514173:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+62:11498:x1870854915962496:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 117us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186571.514181:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 180 00000100:00100000:0.0:1784186571.525890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186571.528746:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915962624 00000100:00100000:2.0:1784186571.528762:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915962624 00000100:00100000:2.0:1784186571.528837:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 181 00000100:00100000:2.0:1784186571.528849:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+62:11498:x1870854915962624:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186571.528871:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186571.528896:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57677a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.528979:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.528994:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.529004:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186571.529041:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186571.529061:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.529088:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57677a expref: 64 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.529111:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57677a expref: 63 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.529121:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fc7718900) 00010000:00010000:2.0:1784186571.529124:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784186571.529128:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c600, rc 0) 00000100:00100000:2.0:1784186571.529213:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+63:11498:x1870854915962624:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 366us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186571.529221:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 181 00000100:00100000:3.0:1784186571.534348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186571.535819:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915962752 00000100:00100000:2.0:1784186571.535834:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915962752 00000100:00100000:2.0:1784186571.535900:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:2.0:1784186571.535917:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915962752:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186571.535938:0:11903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186571.535960:0:11903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19d3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576781 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784186571.535988:0:11903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5886cb, blocks: 0x1 00010000:00010000:2.0:1784186571.536007:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1784186571.536012:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186571.536022:0:11903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19d3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576781 expref: 8 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.536042:0:11903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19d3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576781 expref: 8 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.536057:0:11903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766ce00, rc 0) 00000100:00100000:2.0:1784186571.536128:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2354:x1870854915962752:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 214us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186571.536135:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:0.0:1784186571.547273:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.548178:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915963008 00000100:00100000:3.0:1784186571.548192:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915963008 00000100:00100000:3.0:1784186571.548256:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 182 00000100:00100000:3.0:1784186571.548265:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+63:11498:x1870854915963008:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784186571.548379:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+63:11498:x1870854915963008:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 114us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186571.548387:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 182 00000100:00100000:2.0:1784186571.551885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.552734:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915963136 00000100:00100000:3.0:1784186571.552744:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915963136 00000100:00100000:3.0:1784186571.552803:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:3.0:1784186571.552812:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:11498:x1870854915963136:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186571.552830:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186571.552847:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576788 expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.552877:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19d3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576781 expref: 9 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.552886:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186571.552903:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186571.552909:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 9 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.552944:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19d3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576781 expref: 9 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.552958:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19d3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576781 expref: 9 pid: 11903 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186571.552972:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6311500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870854937978624:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186571.553054:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186571.563524:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.563572:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915963264 00000100:00100000:3.0:1784186571.563582:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915963264 00010000:00010000:3.0:1784186571.563622:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19d3c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576781 expref: 10 pid: 11903 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186571.563668:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:3.0:1784186571.563678:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+10:2356:x1870854915963264:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186571.563696:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186571.563721:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19d3c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576781 expref: 10 pid: 11903 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.563735:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19d3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576781 expref: 10 pid: 11903 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.563777:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186571.563782:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186571.563790:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 10 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.563800:0:11003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 10 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.563839:0:11003:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 10 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186571.563854:0:11003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6312d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11003:1870854937978752:192.168.201.31@tcp:105: 00000100:00100000:3.0:1784186571.563937:0:11003:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f180 going to sleep for 11 seconds 00010000:00010000:1.0:1784186571.564253:0:6581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19d3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576781 expref: 10 pid: 11903 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186571.564269:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6311500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6581:1870854937978624:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186571.564295:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 9 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.564306:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505e00, rc 0) 00000100:00100000:1.0:1784186571.564344:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+9:11498:x1870854915963136:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 11532us (12470us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186571.564352:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:1.0:1784186571.569992:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186571.571649:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915963392 00000100:00100000:2.0:1784186571.571666:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915963392 00002000:00100000:2.0:1784186571.571719:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b9ec576e680 x1870854915963392/t0(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:27/0 lens 504/0 e 0 to 0 dl 1784186582 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186571.571730:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ec576e680 with x1870854915963392 ext(0->8) 00002000:00010000:2.0:1784186571.571735:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9ec576e680 00000100:00100000:2.0:1784186571.571816:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:2.0:1784186571.571836:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2357:x1870854915963392:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784186571.572281:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+11:2357:x1870854915963392:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 Request processed in 443us (2297us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1784186571.572289:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00002000:00100000:2.0:1784186571.572297:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9b9ec576e680 x1870854915963392/t4294967314(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:27/0 lens 504/448 e 0 to 0 dl 1784186582 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186571.572305:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ec576e680 with x1870854915963392 ext(0->8) 00002000:00010000:2.0:1784186571.572308:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9ec576e680 00000100:00100000:3.0:1784186571.573114:0:11003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6312d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11003:1870854937978752:192.168.201.31@tcp:105: 00010000:00010000:3.0:1784186571.573137:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186571.573164:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+10:2356:x1870854915963264:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 9488us (9651us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186571.573173:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:2.0:1784186571.579762:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.579834:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915963520 00000100:00100000:3.0:1784186571.579847:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915963520 00000100:00100000:3.0:1784186571.579905:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 183 00000100:00100000:3.0:1784186571.579915:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+63:11498:x1870854915963520:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784186571.654356:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:2.0:1784186571.654545:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1784186571.654550:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:2.0:1784186571.654566:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1784186571.654587:0:5806:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b9fc2bb9480 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1784186571.654592:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffdf38300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b9fc2bb96c0 00000020:00080000:2.0:1784186571.654596:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffdf38700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b9ffe07c800 00000001:00080000:2.0:1784186571.654610:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1784186571.654656:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1784186571.654838:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1784186571.655089:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186571.655110:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec576ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937978880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784186571.655186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186571.655253:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937978880 00000100:00100000:1.0:1784186571.655261:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937978880 00000100:00100000:1.0:1784186571.655315:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784186571.655325:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937978880:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784186571.655350:0:11903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1784186571.655380:0:11903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a5886c9, atime: 0x6a5886c9, ctime: 0x6a5886c9, blocks: 0x1 00010000:00010000:1.0:1784186571.655401:0:11903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bb23638/0x55bc3e8c99d19d4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.655419:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1784186571.655435:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186571.655477:0:11903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bb23638/0x55bc3e8c99d19d4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.655494:0:11903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bb23638/0x55bc3e8c99d19d4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.655505:0:11903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bb23638/0x55bc3e8c99d19d4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.655512:0:11903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bb23638/0x55bc3e8c99d19d4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.655540:0:11903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784186571.655964:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1870854937978880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 640us (778us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1784186571.655973:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1784186571.655999:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784186571.656012:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186571.656018:0:11501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bb23638/0x55bc3e8c99d19d4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.656026:0:11501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27eca00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186571.656037:0:11501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bb23638/0x55bc3e8c99d19d4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.656047:0:11501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bb23638/0x55bc3e8c99d19d4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.656063:0:11501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bb23638/0x55bc3e8c99d19d4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.656071:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bb23638/0x55bc3e8c99d19d4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.656089:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186571.656091:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186571.656092:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784186571.656121:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b9ec576ea00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1784186571.656127:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec576ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937978880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1784186571.656468:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784186571.656484:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937979008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1784186571.656533:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186571.656574:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937979008 00000100:00100000:0.0:1784186571.656578:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937979008 00000100:00100000:0.0:1784186571.656614:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784186571.656621:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937979008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1784186571.656744:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784186571.656747:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784186571 00002000:00010000:0.0:1784186571.656750:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784186571.656752:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1784186571 -> 1784186571 00002000:00010000:0.0:1784186571.656754:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784186571.656786:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1870854937979008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (263us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1784186571.656803:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:0.0:1784186571.656840:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b9ec6f87b80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1784186571.656844:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937979008:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1784186571.657044:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186571.657232:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+18:11498:x1870854915963520:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 Request processed in 77317us (77474us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186571.657251:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 183 00000100:00100000:3.0:1784186571.659701:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186571.659922:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915963648 00000100:00100000:1.0:1784186571.659933:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915963648 00000100:00100000:1.0:1784186571.659983:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:1.0:1784186571.659993:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+10:2357:x1870854915963648:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1784186571.703940:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+10:2357:x1870854915963648:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 Request processed in 43940us (44239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186571.703955:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00000001:00080000:1.0:1784186571.703993:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:1.0:1784186571.704006:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:1.0:1784186571.704022:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1784186571.713745:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186571.713906:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915963904 00000100:00100000:2.0:1784186571.713916:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915963904 00000100:00100000:2.0:1784186571.713978:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 184 00000100:00100000:2.0:1784186571.713988:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+18:11498:x1870854915963904:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784186571.714048:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186571.714079:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57677a expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.714114:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fc7718900) 00010000:00010000:2.0:1784186571.714119:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186571.714154:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.714168:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.714177:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784186571.714652:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c799f70 reply state 0000000023effd61 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186571.714664:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186571.714771:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+19:11498:x1870854915963904:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 784us (1034us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1784186571.714780:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 184 00010000:00010000:2.0:1784186571.717323:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.717341:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.717348:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.717355:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186571.717360:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.717383:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.717399:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fc7718900) 00010000:00010000:2.0:1784186571.717402:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186571.717407:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.717414:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186571.717858:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186571.718305:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915964032 00000100:00100000:0.0:1784186571.718315:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915964032 00000100:00100000:0.0:1784186571.718374:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:0.0:1784186571.718385:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6313100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2355:x1870854915964032:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784186571.718689:0:6584:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1784186571.718692:0:6584:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1784186571 -> 1784186570 00002000:00010000:0.0:1784186571.718695:0:6584:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784186569 00002000:00010000:0.0:1784186571.718698:0:6584:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1784186571 -> 1784186570 00002000:00010000:0.0:1784186571.718700:0:6584:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1784186571.718759:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6313100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2355:x1870854915964032:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 375us (904us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784186571.718766:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:3.0:1784186571.721100:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186571.721175:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915964288 00000100:00100000:2.0:1784186571.721184:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915964288 00000100:00100000:2.0:1784186571.721243:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 185 00000100:00100000:2.0:1784186571.721254:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+18:11498:x1870854915964288:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784186571.721327:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.721343:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19d19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57676c expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.721353:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.721389:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57676c expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.721404:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19d19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57676c expref: 18 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186571.721437:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec7297800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937979136:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186571.721577:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fef8869c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186571.734107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186571.734156:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915964416 00000100:00100000:0.0:1784186571.734167:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915964416 00010000:00010000:0.0:1784186571.734216:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19d19 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57676c expref: 19 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186571.734255:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:0.0:1784186571.734264:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe54bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+19:2356:x1870854915964416:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186571.734279:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186571.734286:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19d19 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57676c expref: 19 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.734314:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19d19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57676c expref: 19 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.734339:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fc7718900) 00010000:00010000:0.0:1784186571.734344:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.734366:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.734373:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.734392:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186571.734481:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe54bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+19:2356:x1870854915964416:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 217us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186571.734489:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00010000:00010000:1.0:1784186571.734686:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19d19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57676c expref: 18 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186571.734702:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec7297800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937979136:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186571.734724:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.734733:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.734738:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.734767:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.734774:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.734781:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.734788:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186571.734792:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.734800:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.734808:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fc7718900) 00010000:00010000:1.0:1784186571.734817:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784186571.734822:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.734828:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19d58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186571.734880:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+17:11498:x1870854915964288:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 Request processed in 13627us (13786us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784186571.734889:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 185 00000100:00100000:3.0:1784186571.746752:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.746802:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915964544 00000100:00100000:3.0:1784186571.746811:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915964544 00000100:00100000:3.0:1784186571.746872:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:3.0:1784186571.746883:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2355:x1870854915964544:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784186571.746931:0:6583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.746952:0:6583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.746961:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186571.746966:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784186571.746971:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.747006:0:6583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.747021:0:6583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 8 pid: 6581 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186571.747051:0:6583:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6310380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6583:1870854937979264:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186571.747131:0:6583:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5452a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784186571.759315:0:6583:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6310380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6583:1870854937979264:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186571.759356:0:6583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186571.759413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186571.764163:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915964672 00000100:00100000:1.0:1784186571.764177:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915964672 00010000:00010000:1.0:1784186571.764225:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 9 pid: 6581 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186571.764273:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:1.0:1784186571.764284:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2356:x1870854915964672:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186571.764300:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186571.764326:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 9 pid: 6581 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.764340:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 9 pid: 6581 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.764364:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef31e2f2/0x55bc3e8c99d19d43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576788 expref: 9 pid: 6581 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.764381:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186571.764394:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186571.764400:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.764411:0:5768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.764826:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186571.764895:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2356:x1870854915964672:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 611us (5481us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186571.764905:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 70 00010000:00010000:2.0:1784186571.769587:0:6583:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186571.769607:0:6583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.770374:0:6583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.770388:0:6583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.770396:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.770403:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505c00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186571.770407:0:6583:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.770416:0:6583:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.770927:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.770938:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d19d5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186571.771060:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2355:x1870854915964544:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 Request processed in 24174us (24331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186571.771070:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:0.0:1784186571.774815:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186571.774897:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915964928 00000100:00100000:1.0:1784186571.774908:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915964928 00000100:00100000:1.0:1784186571.774974:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 186 00000100:00100000:1.0:1784186571.774985:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+17:11498:x1870854915964928:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784186571.775089:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.775110:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.775125:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.775336:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.775348:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19d27 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576773 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.775376:0:7478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.775415:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19d27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576773 expref: 18 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.775430:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19d27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576773 expref: 18 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186571.775483:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec576c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937979392:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186571.775567:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcd746d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784186571.778165:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec576c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937979392:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186571.778199:0:7478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186571.779210:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186571.779280:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915965056 00000100:00100000:1.0:1784186571.779288:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915965056 00010000:00010000:1.0:1784186571.779327:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19d27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576773 expref: 19 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186571.779370:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:1.0:1784186571.779379:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+19:2357:x1870854915965056:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186571.779394:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186571.779401:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19d27 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576773 expref: 19 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.779414:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19d27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576773 expref: 19 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.779478:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19d27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576773 expref: 19 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.779508:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fc7718900) 00010000:00010000:1.0:1784186571.779513:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.779523:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.779536:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.779559:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186571.779612:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+18:2357:x1870854915965056:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 234us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186571.779620:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 71 00010000:00010000:0.0:1784186571.779695:0:7478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.779702:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784186571.779891:0:7478:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1784186571.780035:0:7478:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1784186571.780078:0:7478:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1784186571.780157:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec71ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7478:1870854937979520:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784186571.780202:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186571.780229:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5416d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784186571.781647:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937979520 00000100:00100000:0.0:1784186571.781659:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937979520 00000100:00100000:0.0:1784186571.781713:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784186571.781721:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7478:x1870854937979520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784186571.781818:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7478:x1870854937979520:12345-0@lo:1000:mdt00_003.0 Request processed in 98us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186571.781825:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784186571.781916:0:7478:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1784186571.781922:0:7478:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b9ec6f87b80, transno 4294967315 00000100:00100000:1.0:1784186571.781937:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec71ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7478:1870854937979520:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1784186571.784916:0:7478:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1784186571.785019:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec576df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7478:1870854937979648:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784186571.785098:0:7478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186571.785139:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fcd746840 going to sleep for 11 seconds 00000100:00100000:2.0:1784186571.785266:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937979648 00000100:00100000:2.0:1784186571.785274:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937979648 00000100:00100000:2.0:1784186571.785328:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784186571.785338:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7478:x1870854937979648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784186571.785612:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7478:x1870854937979648:12345-0@lo:1000:mdt00_003.0 Request processed in 275us (513us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1784186571.785620:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784186571.785874:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec576df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7478:1870854937979648:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1784186571.785912:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.785922:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.785942:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.785949:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27eda00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186571.785953:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.785961:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.785979:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fc7718900) 00010000:00010000:1.0:1784186571.785982:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186571.785987:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.785993:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19d6d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786022:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19ca2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786029:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19ca2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786035:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19ca2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786040:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186571.786043:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19ca2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786060:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19ca2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786069:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718700) 00010000:00010000:1.0:1784186571.786072:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186571.786075:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19ca2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786080:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19ca2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786105:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786120:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576757 expref: 21 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786129:0:7478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786156:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576757 expref: 21 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.786173:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576757 expref: 21 pid: 7478 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186571.786187:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec576d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937979776:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186571.786268:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe54169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186571.790338:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec576d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937979776:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186571.790373:0:7478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186571.792475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186571.792685:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915965184 00000100:00100000:3.0:1784186571.792694:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915965184 00010000:00010000:3.0:1784186571.792733:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576757 expref: 22 pid: 7478 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186571.792782:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:3.0:1784186571.792792:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+22:2356:x1870854915965184:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186571.792806:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186571.792813:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576757 expref: 22 pid: 7478 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.792826:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576757 expref: 22 pid: 7478 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.792847:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19cbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576757 expref: 22 pid: 7478 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.792860:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718700) 00010000:00010000:3.0:1784186571.792866:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.792877:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.792897:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186571.792921:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186571.792982:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+21:2356:x1870854915965184:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 191us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186571.792990:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 72 00010000:00010000:1.0:1784186571.793144:0:7478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793153:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793166:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793173:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793180:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793186:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27eca00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186571.793191:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793197:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793205:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718700) 00010000:00010000:1.0:1784186571.793208:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186571.793212:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793217:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19d74 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793235:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793242:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793248:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793253:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186571.793256:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793263:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793271:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718700) 00010000:00010000:1.0:1784186571.793274:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784186571.793276:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.793282:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784186571.793844:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784186571.793850:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1784186571.794547:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+20:11498:x1870854915964928:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 19559us (19742us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1784186571.794558:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 186 00000020:00080000:1.0:1784186571.794562:0:7478:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784186571.797706:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1784186571.797726:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784186571.812735:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186571.816721:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915965440 00000100:00100000:1.0:1784186571.816740:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915965440 00000100:00100000:1.0:1784186571.816826:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:1.0:1784186571.816838:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+20:11498:x1870854915965440:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784186571.818962:0:5786:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784186571.819076:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1784186571.819139:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.819157:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.819168:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.819179:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d7b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.819185:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d7b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.819192:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186571.819261:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784186571.819402:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+22:11498:x1870854915965440:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 2562us (6672us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1784186571.819412:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 50 00000020:00080000:1.0:1784186571.819418:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784186571.819717:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186571.819725:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.819733:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186571.819737:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.819745:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.819758:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9b9fd1d53700) 00010000:00010000:0.0:1784186571.819761:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784186571.819766:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d7b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.819778:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19d7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186571.819793:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186571.819795:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186571.819797:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186571.838831:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784186571.886999:0:12347:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784186571.887010:0:12347:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784186571.887060:0:12347:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1784186571.887066:0:12347:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784186572.001216:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.001296:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915965696 00000100:00100000:3.0:1784186572.001307:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915965696 00000100:00100000:3.0:1784186572.001388:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 187 00000100:00100000:3.0:1784186572.001399:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+22:11507:x1870854915965696:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186572.001433:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186572.001478:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19d82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57678f expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.001750:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19d89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.001765:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19d89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.001777:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19d89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186572.001789:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1784186572.001978:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19d82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57678f expref: 25 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.001995:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19d89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57678f expref: 24 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.002004:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:3.0:1784186572.002007:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784186572.002011:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505c00, rc 0) 00000100:00100000:3.0:1784186572.002074:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe241180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+24:11507:x1870854915965696:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 677us (867us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1784186572.002081:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 187 00000100:00080000:0.0:1784186572.002204:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186572.005246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.005324:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915965824 00000100:00100000:2.0:1784186572.005360:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915965824 00000100:00100000:2.0:1784186572.005428:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 188 00000100:00100000:2.0:1784186572.005478:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+24:11507:x1870854915965824:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:2.0:1784186572.005573:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005590:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005602:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005616:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005623:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005630:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005902:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005911:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005918:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784186572.005953:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005974:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005980:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005987:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.005993:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.005997:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006005:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006017:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186572.006020:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.006024:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006031:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19d97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006043:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006049:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006055:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006065:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.006069:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006075:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006082:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc5142500) 00010000:00010000:2.0:1784186572.006085:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.006087:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006094:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006108:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006115:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19da5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006121:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006126:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766ce00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.006129:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006134:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19da5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006150:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142600) 00010000:00010000:2.0:1784186572.006152:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.006155:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19da5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.006161:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19da5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186572.006230:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+24:11507:x1870854915965824:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 791us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186572.006239:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 188 00000100:00100000:3.0:1784186572.043778:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.043804:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915966080 00000100:00100000:3.0:1784186572.043811:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915966080 00000100:00100000:3.0:1784186572.043853:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 189 00000100:00100000:3.0:1784186572.043860:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+24:11511:x1870854915966080:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186572.043876:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186572.043892:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19dac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576796 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.043949:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19db3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.043959:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.043967:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.043982:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.043986:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.043991:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044223:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19dc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044229:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044233:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186572.044240:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1784186572.044309:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19db3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044314:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19db3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044318:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19db3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044322:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186572.044325:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19db3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044337:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19db3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044345:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:3.0:1784186572.044347:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186572.044351:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19db3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044357:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19db3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044368:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044389:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19dba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044395:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044401:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505a00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186572.044404:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044410:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19dba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044418:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc7718b00) 00010000:00010000:3.0:1784186572.044421:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186572.044423:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19dba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044470:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044514:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19dac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576796 expref: 27 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044529:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576796 expref: 26 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.044536:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:3.0:1784186572.044538:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186572.044541:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505600, rc 0) 00000100:00100000:3.0:1784186572.044603:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+26:11511:x1870854915966080:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 741us (831us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1784186572.044608:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 189 00000100:00100000:3.0:1784186572.047986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.048373:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915966208 00000100:00100000:2.0:1784186572.048429:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915966208 00000100:00100000:2.0:1784186572.048511:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 190 00000100:00100000:2.0:1784186572.048523:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+26:11511:x1870854915966208:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:2.0:1784186572.048595:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19dcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.048613:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.048625:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.048650:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.048655:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19dcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.048667:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.048672:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766ce00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.048675:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.048679:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19dcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.048688:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:2.0:1784186572.048690:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784186572.048693:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19dcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.048698:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d19dcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186572.048756:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+26:11511:x1870854915966208:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 236us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186572.048763:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 190 00000100:00100000:3.0:1784186572.050381:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.050523:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915966464 00000100:00100000:2.0:1784186572.050531:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915966464 00000100:00100000:2.0:1784186572.050581:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:2.0:1784186572.050589:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+26:11511:x1870854915966464:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1784186572.050767:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+27:11511:x1870854915966464:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 178us (393us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1784186572.050775:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:3.0:1784186572.086977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186572.087390:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915966720 00000100:00100000:0.0:1784186572.087401:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915966720 00000100:00100000:0.0:1784186572.087482:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 191 00000100:00100000:0.0:1784186572.087493:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+27:11045:x1870854915966720:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1784186572.087628:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186572.087654:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19dd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57679d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.087752:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.087763:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19dc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576796 expref: 28 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.087769:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.087794:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576796 expref: 28 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.087803:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19dc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576796 expref: 28 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186572.087822:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe241c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937979904:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186572.087914:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd629e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186572.091398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.091471:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915966848 00000100:00100000:3.0:1784186572.091479:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915966848 00010000:00010000:3.0:1784186572.091519:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19dc1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576796 expref: 29 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.091556:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:3.0:1784186572.091568:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+29:2357:x1870854915966848:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186572.091603:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186572.091611:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19dc1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576796 expref: 29 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.091625:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19dc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576796 expref: 29 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.091649:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:3.0:1784186572.091654:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.091664:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.091672:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.091694:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186572.091752:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+29:2357:x1870854915966848:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 187us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186572.091760:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 73 00010000:00010000:3.0:1784186572.093253:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19dc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576796 expref: 28 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.093273:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe241c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937979904:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186572.093295:0:5782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.093304:0:5782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.093322:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186572.093342:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1784186572.093981:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19dd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57679d expref: 29 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.093999:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57679d expref: 28 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.094007:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:3.0:1784186572.094010:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784186572.094013:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fbc00, rc 0) 00000100:00100000:3.0:1784186572.094072:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+28:11045:x1870854915966720:12345-192.168.201.31@tcp:101:bash.0 Request processed in 6581us (7102us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1784186572.094081:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 191 00000100:00100000:0.0:1784186572.096408:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.096744:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915967104 00000100:00100000:3.0:1784186572.096754:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915967104 00000100:00100000:3.0:1784186572.096813:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 192 00000100:00100000:3.0:1784186572.096824:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+28:11045:x1870854915967104:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:3.0:1784186572.097090:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19deb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.097110:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.097122:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784186572.097200:0:7478:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1784186572.097226:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ccf09d13 reply state 0000000034c44563 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.097236:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1784186572.097284:0:7478:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1784186572.097888:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe241c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+32:11045:x1870854915967104:12345-192.168.201.31@tcp:36:bash.0 Request processed in 1062us (1485us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1784186572.097897:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 192 00000020:00080000:3.0:1784186572.097902:0:7478:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1784186572.099664:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.099679:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19deb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.099686:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19deb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.099692:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186572.099697:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19deb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.099703:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19deb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.099718:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:3.0:1784186572.099721:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186572.099725:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19deb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.099747:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19deb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186572.100727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186572.100930:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915967232 00000100:00100000:1.0:1784186572.100938:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915967232 00000100:00100000:1.0:1784186572.100983:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 193 00000100:00100000:1.0:1784186572.100998:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+31:11045:x1870854915967232:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1784186572.101020:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186572.101034:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19df2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767a4 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.101081:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19df2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767a4 expref: 32 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.101090:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19df2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767a4 expref: 32 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.101102:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:1.0:1784186572.101104:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186572.101106:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27eda00, rc 0) 00000100:00100000:1.0:1784186572.101155:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe241500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+32:11045:x1870854915967232:12345-192.168.201.31@tcp:101:bash.0 Request processed in 157us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186572.101162:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 193 00000100:00100000:0.0:1784186572.104837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.104932:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915967360 00000100:00100000:2.0:1784186572.104941:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915967360 00000100:00100000:2.0:1784186572.105000:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:2.0:1784186572.105012:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:11045:x1870854915967360:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1784186572.105030:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186572.105051:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19df9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767ab expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784186572.105078:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5886ca, atime: 0x6a5886c9, ctime: 0x6a5886ca, blocks: 0xb 00010000:00010000:2.0:1784186572.105100:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1784186572.105104:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186572.105112:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ab expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.105129:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ab expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.105143:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766ce00, rc 0) 00000100:00100000:2.0:1784186572.105204:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:11045:x1870854915967360:12345-192.168.201.31@tcp:101:bash.0 Request processed in 194us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186572.105212:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:2.0:1784186572.109747:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.109850:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915967488 00000100:00100000:3.0:1784186572.109859:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915967488 00002000:00010000:3.0:1784186572.109902:0:6589:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1784186572.109908:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ec7297800 with x1870854915967488 ext(0->18446744073709551615) 00002000:00010000:3.0:1784186572.109920:0:6589:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9ec7297800. 00000100:00100000:3.0:1784186572.109988:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:3.0:1784186572.109999:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec7297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2354:x1870854915967488:12345-192.168.201.31@tcp:10:bash.0 00002000:00010000:3.0:1784186572.110259:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1784186572.110263:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1784186570 -> 1784186572 00002000:00010000:3.0:1784186572.110266:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1784186569 -> 1784186569 00002000:00010000:3.0:1784186572.110268:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1784186570 -> 1784186572 00002000:00010000:3.0:1784186572.110270:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1784186572.110370:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec7297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2354:x1870854915967488:12345-192.168.201.31@tcp:10:bash.0 Request processed in 372us (631us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1784186572.110377:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00002000:00010000:3.0:1784186572.110382:0:6589:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1784186572.110384:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ec7297800 with x1870854915967488 ext(0->18446744073709551615) 00002000:00010000:3.0:1784186572.110390:0:6589:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9ec7297800. 00000100:00100000:0.0:1784186572.187426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.187639:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915967616 00000100:00100000:2.0:1784186572.187649:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915967616 00000100:00100000:2.0:1784186572.187702:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 194 00000100:00100000:2.0:1784186572.187711:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+32:11525:x1870854915967616:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:2.0:1784186572.187793:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.187809:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.187820:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.187833:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.187840:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.187847:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188112:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188121:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188126:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784186572.188163:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188174:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188191:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188197:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188204:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.188208:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188215:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188226:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186572.188229:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.188233:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188240:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188251:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188257:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188263:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188268:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.188275:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188280:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188287:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc5142500) 00010000:00010000:2.0:1784186572.188290:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.188292:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188298:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188312:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188317:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188323:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188327:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.188330:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188336:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188344:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:2.0:1784186572.188346:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.188356:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.188362:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186572.188505:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe240380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+32:11525:x1870854915967616:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 793us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186572.188514:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 194 00000100:00100000:0.0:1784186572.215699:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186572.215798:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915967872 00000100:00100000:1.0:1784186572.215809:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915967872 00000100:00100000:1.0:1784186572.215869:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 195 00000100:00100000:1.0:1784186572.215879:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+32:11528:x1870854915967872:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1784186572.215901:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186572.215925:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d19e15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767b2 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.215995:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19e1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216023:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19e1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216032:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19e1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216042:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19e23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216046:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216050:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216297:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19e2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216305:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216312:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186572.216321:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784186572.216417:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19e1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216425:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19e1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216432:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19e1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216499:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ece00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186572.216503:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19e1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216510:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19e1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216524:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:1.0:1784186572.216527:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186572.216531:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19e1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216537:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ece00/0x55bc3e8c99d19e1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216547:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19e23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216552:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19e23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216558:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19e23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216563:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ede00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186572.216565:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19e23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216570:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19e23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216584:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fd1d53a00) 00010000:00010000:1.0:1784186572.216586:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186572.216589:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19e23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216594:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d19e23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216628:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d19e15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767b2 expref: 35 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216639:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767b2 expref: 34 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.216645:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:1.0:1784186572.216647:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784186572.216649:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27edc00, rc 0) 00000100:00100000:1.0:1784186572.216805:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe242a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+34:11528:x1870854915967872:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 926us (1116us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1784186572.216812:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 195 00000100:00100000:0.0:1784186572.220162:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.220240:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915968000 00000100:00100000:3.0:1784186572.220249:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915968000 00000100:00100000:3.0:1784186572.220301:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 196 00000100:00100000:3.0:1784186572.220309:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+34:11528:x1870854915968000:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:3.0:1784186572.220394:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.220411:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57679d expref: 34 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.220431:0:7478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.220510:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57679d expref: 34 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.220528:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57679d expref: 34 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.220541:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6310700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937980032:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186572.220615:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784186572.225271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.225355:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915968256 00000100:00100000:2.0:1784186572.225364:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915968256 00000100:00100000:2.0:1784186572.225432:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:2.0:1784186572.225482:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+35:5569:x1870854915968256:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784186572.225795:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+36:5569:x1870854915968256:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 354us (531us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1784186572.225803:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:3.0:1784186572.226273:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6310700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937980032:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186572.226298:0:7478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186572.227228:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.227287:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915968384 00000100:00100000:3.0:1784186572.227293:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915968384 00010000:00010000:3.0:1784186572.227325:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57679d expref: 36 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.227361:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 74 00000100:00100000:3.0:1784186572.227370:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+36:2356:x1870854915968384:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186572.227398:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186572.227406:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57679d expref: 36 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.227428:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57679d expref: 36 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.227492:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbc00/0x55bc3e8c99d19ddd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57679d expref: 36 pid: 5782 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.227504:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:3.0:1784186572.227507:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.227514:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.227526:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.227549:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186572.227578:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+35:2356:x1870854915968384:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 210us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186572.227583:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 74 00010000:00010000:1.0:1784186572.227633:0:7478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.227638:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.227659:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.227671:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.227675:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.227678:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186572.227681:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.227686:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.227691:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:1.0:1784186572.227693:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784186572.227695:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.227699:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d19e38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186572.227727:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+34:11528:x1870854915968000:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 7420us (7575us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186572.227732:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 196 00000100:00100000:0.0:1784186572.230737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.230812:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915968640 00000100:00100000:2.0:1784186572.230821:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915968640 00000100:00100000:2.0:1784186572.230867:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:2.0:1784186572.230881:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+34:11528:x1870854915968640:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:2.0:1784186572.231073:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+35:11528:x1870854915968640:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 192us (344us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1784186572.231078:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:0.0:1784186572.289234:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.289340:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915968896 00000100:00100000:2.0:1784186572.289363:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915968896 00000100:00100000:2.0:1784186572.289425:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 197 00000100:00100000:2.0:1784186572.289473:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+35:11538:x1870854915968896:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:2.0:1784186572.289517:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186572.289540:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767b9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.289625:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.289640:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.289653:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.289667:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.289675:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.289683:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290011:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290021:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290028:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186572.290037:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1784186572.290140:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290149:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290157:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290164:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.290169:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290176:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290189:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186572.290193:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.290198:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290204:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290220:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290225:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290231:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290235:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.290244:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290249:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290256:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc5142500) 00010000:00010000:2.0:1784186572.290259:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.290261:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290268:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290319:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767b9 expref: 38 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290333:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767b9 expref: 37 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.290340:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:2.0:1784186572.290342:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186572.290345:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766cc00, rc 0) 00000100:00100000:2.0:1784186572.290427:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+37:11538:x1870854915968896:12345-192.168.201.31@tcp:101:cat.0 Request processed in 992us (1200us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1784186572.290502:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 197 00000100:00100000:0.0:1784186572.294800:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.294880:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915969152 00000100:00100000:2.0:1784186572.294891:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915969152 00000100:00100000:2.0:1784186572.294947:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:2.0:1784186572.294957:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+37:11538:x1870854915969152:12345-192.168.201.31@tcp:35:cat.0 00000100:00100000:2.0:1784186572.295207:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+38:11538:x1870854915969152:12345-192.168.201.31@tcp:35:cat.0 Request processed in 251us (416us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1784186572.295216:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 54 00000100:00100000:0.0:1784186572.308730:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.309135:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915969408 00000100:00100000:2.0:1784186572.309146:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915969408 00000100:00100000:2.0:1784186572.309257:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 198 00000100:00100000:2.0:1784186572.309268:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+38:11540:x1870854915969408:12345-192.168.201.31@tcp:36:rm.0 00010000:00010000:2.0:1784186572.309323:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784186572.309361:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767b9 expref: 38 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.309386:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19e2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767b2 expref: 37 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.309398:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19df2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767a4 expref: 36 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.309408:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:2.0:1784186572.309419:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186572.309496:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.309510:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.309520:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.309548:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.309556:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.309563:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.309812:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.309818:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.309823:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784186572.310271:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:2.0:1784186572.310323:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19e77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.310332:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.310341:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.310348:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19e77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.310354:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19e77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.310368:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.310397:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784186572.310418:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.310425:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.310432:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.310475:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186572.310477:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186572.310480:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.310483:0:11501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19e77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.310487:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.310489:0:11501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766dc00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186572.310497:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186572.310499:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784186572.310503:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.310655:0:11501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19e77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.310663:0:11501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19e77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.310673:0:11501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:3.0:1784186572.310675:0:11501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784186572.310678:0:11501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19e77 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.310683:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19e77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.310695:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186572.310697:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186572.310699:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186572.311192:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.311212:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.311216:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.311227:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.311230:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.311232:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.311235:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.311241:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186572.311243:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.311245:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.311248:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784186572.311254:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000066965b8d reply state 00000000ff9df19c transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186572.311261:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186572.311402:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+37:11540:x1870854915969408:12345-192.168.201.31@tcp:36:rm.0 Request processed in 2132us (2677us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1784186572.311411:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 198 00010000:00010000:2.0:1784186572.318388:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.318408:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.318466:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.318475:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.318481:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.318489:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.318505:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc5142500) 00010000:00010000:2.0:1784186572.318509:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.318514:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.318522:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186572.352581:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.352706:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915969664 00000100:00100000:2.0:1784186572.352716:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915969664 00000100:00100000:2.0:1784186572.352775:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 199 00000100:00100000:2.0:1784186572.352784:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+36:11546:x1870854915969664:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1784186572.352810:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186572.352830:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767c0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.352971:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353005:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353017:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353033:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353040:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353046:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784186572.353649:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1784186572.353772:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353779:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353784:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353808:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353813:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e85 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353817:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353826:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.353829:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353834:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353843:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186572.353844:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.353848:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e85 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353852:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19e85 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784186572.353861:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045d8b4bd reply state 0000000071e59648 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186572.353867:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784186572.353887:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19e7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c0 expref: 39 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353896:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c0 expref: 38 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.353901:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186572.353903:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186572.353904:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766cc00, rc 0) 00000100:00100000:2.0:1784186572.353954:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+39:11546:x1870854915969664:12345-192.168.201.31@tcp:101:bash.0 Request processed in 1171us (1385us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1784186572.353965:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 199 00010000:00010000:3.0:1784186572.356068:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.356085:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.356091:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.356097:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186572.356101:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.356107:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.356140:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc5142500) 00010000:00010000:3.0:1784186572.356143:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186572.356147:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.356153:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19e8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186572.358284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186572.358388:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915969792 00000100:00100000:1.0:1784186572.358398:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915969792 00000100:00100000:1.0:1784186572.358490:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:1.0:1784186572.358501:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2355:x1870854915969792:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1784186572.358523:0:11903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186572.358558:0:11903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d19ea1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767c7 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784186572.358588:0:11903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186572.358607:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1784186572.358612:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186572.358623:0:11903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d19ea1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c7 expref: 8 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.358640:0:11903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d19ea1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c7 expref: 8 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.358653:0:11903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ed600, rc 0) 00000100:00100000:1.0:1784186572.358700:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2355:x1870854915969792:12345-192.168.201.31@tcp:101:bash.0 Request processed in 202us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186572.358705:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:0.0:1784186572.366211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186572.366275:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915969920 00000100:00100000:1.0:1784186572.366283:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915969920 00000100:00100000:1.0:1784186572.366340:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:1.0:1784186572.366357:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:11546:x1870854915969920:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1784186572.366374:0:6581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186572.366394:0:6581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767ce expref: -99 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.366427:0:6581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d19ea1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c7 expref: 9 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.366488:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186572.366493:0:6581:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186572.366500:0:6581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 9 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.366535:0:6581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d19ea1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c7 expref: 9 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.366549:0:6581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d19ea1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c7 expref: 9 pid: 11903 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186572.366565:0:6581:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec576d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870854937980160:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186572.366643:0:6581:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5416cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186572.368649:0:6581:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec576d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6581:1870854937980160:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186572.368687:0:6581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 9 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.368708:0:6581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ede00, rc 0) 00000100:00100000:1.0:1784186572.368765:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+9:11546:x1870854915969920:12345-192.168.201.31@tcp:101:bash.0 Request processed in 2416us (2563us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186572.368772:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:0.0:1784186572.373814:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.373984:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915970048 00000100:00100000:3.0:1784186572.373994:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915970048 00010000:00010000:3.0:1784186572.374036:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d19ea1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c7 expref: 9 pid: 11903 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.374111:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 75 00000100:00100000:3.0:1784186572.374122:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001286300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2356:x1870854915970048:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186572.374137:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186572.374160:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d19ea1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c7 expref: 9 pid: 11903 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.374175:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d19ea1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c7 expref: 9 pid: 11903 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.374199:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d19ea1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c7 expref: 9 pid: 11903 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.374217:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186572.374236:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186572.374246:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.374256:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.374310:0:5769:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.374325:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6310700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5769:1870854937980288:192.168.201.31@tcp:105: 00000100:00100000:3.0:1784186572.374784:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784186572.377865:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6310700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5769:1870854937980288:192.168.201.31@tcp:105: 00010000:00010000:3.0:1784186572.377894:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186572.377952:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001286300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2356:x1870854915970048:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 3831us (4147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186572.377964:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 75 00000100:00100000:2.0:1784186572.379544:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186572.379734:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915970304 00000100:00100000:0.0:1784186572.379743:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915970304 00000100:00100000:0.0:1784186572.379797:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:0.0:1784186572.379808:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe557a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+38:11546:x1870854915970304:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:0.0:1784186572.380189:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe557a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+39:11546:x1870854915970304:12345-192.168.201.31@tcp:35:bash.0 Request processed in 381us (652us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1784186572.380197:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 55 00000100:00100000:0.0:1784186572.507021:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.507139:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915970432 00000100:00100000:3.0:1784186572.507149:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915970432 00000100:00100000:3.0:1784186572.507211:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 200 00000100:00100000:3.0:1784186572.507221:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+39:11562:x1870854915970432:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186572.507244:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186572.507266:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19eaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767d5 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.507337:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.507383:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.507396:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186572.507500:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1784186572.507505:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186572.507704:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.507731:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19eaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767d5 expref: 41 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.507749:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767d5 expref: 40 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.507758:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:3.0:1784186572.507761:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186572.507764:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504400, rc 0) 00000100:00100000:3.0:1784186572.507821:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+40:11562:x1870854915970432:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 602us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186572.507828:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 200 00000100:00100000:0.0:1784186572.511864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.511950:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915970688 00000100:00100000:2.0:1784186572.511960:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915970688 00000100:00100000:2.0:1784186572.512018:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 201 00000100:00100000:2.0:1784186572.512028:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+40:11562:x1870854915970688:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186572.512046:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186572.512067:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19ebd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767dc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.512170:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19ec4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.512185:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.512194:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186572.512204:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784186572.512324:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d19ebd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767dc expref: 43 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.512343:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767dc expref: 42 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.512369:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186572.512371:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186572.512388:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d200, rc 0) 00000100:00100000:2.0:1784186572.512489:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+42:11562:x1870854915970688:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 462us (638us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1784186572.512496:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 201 00000100:00100000:0.0:1784186572.524480:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.527636:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915970816 00000100:00100000:3.0:1784186572.527654:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915970816 00000100:00100000:3.0:1784186572.527729:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:3.0:1784186572.527740:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe54ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+42:2357:x1870854915970816:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186572.527758:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186572.527793:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19ec4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767dc expref: 42 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.527812:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:3.0:1784186572.527818:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186572.527881:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe54ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+41:2357:x1870854915970816:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 143us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186572.527889:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:3.0:1784186572.527988:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.528062:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915971072 00000100:00100000:3.0:1784186572.528066:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915971072 00000100:00100000:3.0:1784186572.528092:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 202 00000100:00100000:3.0:1784186572.528099:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+41:11562:x1870854915971072:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186572.528118:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186572.528135:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19ed2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767e3 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.528229:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19ed9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.528243:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.528253:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19ed9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186572.528265:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784186572.528385:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19ed2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767e3 expref: 44 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.528413:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767e3 expref: 43 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.528421:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:3.0:1784186572.528423:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784186572.528426:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504800, rc 0) 00000100:00100000:3.0:1784186572.528509:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+43:11562:x1870854915971072:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 410us (521us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1784186572.528515:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 202 00000100:00100000:0.0:1784186572.537624:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186572.537717:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915971200 00000100:00100000:1.0:1784186572.537728:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915971200 00000100:00100000:1.0:1784186572.537791:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:1.0:1784186572.537814:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2354:x1870854915971200:12345-192.168.201.31@tcp:1:lfs.0 00010000:00010000:1.0:1784186572.537858:0:11903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.537879:0:11903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.537888:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186572.537893:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186572.537898:0:11903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.537931:0:11903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 8 pid: 6581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.537947:0:11903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 8 pid: 6581 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186572.537961:0:11903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec576d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11903:1870854937980416:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186572.538135:0:11903:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5416cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186572.546088:0:11903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec576d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11903:1870854937980416:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186572.546124:0:11903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186572.549428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.549699:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915971328 00000100:00100000:2.0:1784186572.549709:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915971328 00002000:00100000:2.0:1784186572.549764:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ba001286a00 x1870854915971328/t0(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:28/0 lens 504/0 e 0 to 0 dl 1784186583 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186572.549775:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba001286a00 with x1870854915971328 ext(0->8) 00010000:00010000:2.0:1784186572.549786:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 9 pid: 6581 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.549805:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 9 pid: 6581 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784186572.549815:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ba001286a00 00000100:00100000:2.0:1784186572.549849:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:2.0:1784186572.549859:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2356:x1870854915971328:12345-192.168.201.31@tcp:4:lfs.0 00000100:00100000:2.0:1784186572.550464:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+11:2356:x1870854915971328:12345-192.168.201.31@tcp:4:lfs.0 Request processed in 570us (1018us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784186572.550473:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00002000:00100000:2.0:1784186572.550482:0:6588:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ba001286a00 x1870854915971328/t4294967308(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:28/0 lens 504/448 e 0 to 0 dl 1784186583 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186572.550491:0:6588:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba001286a00 with x1870854915971328 ext(0->8) 00010000:00010000:2.0:1784186572.550498:0:6588:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 11 pid: 6581 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.550526:0:6588:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 11 pid: 6581 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784186572.550533:0:6588:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ba001286a00 00000001:00080000:3.0:1784186572.551158:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1784186572.551176:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1784186572.554278:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.554573:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915971456 00000100:00100000:3.0:1784186572.554583:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915971456 00010000:00010000:3.0:1784186572.554631:0:5767:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 9 pid: 6581 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.554723:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 76 00000100:00100000:3.0:1784186572.554733:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2357:x1870854915971456:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186572.554750:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784186572.554769:0:5767:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784186572.554772:0:5767:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784186572 00002000:00010000:3.0:1784186572.554774:0:5767:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784186572 00002000:00010000:3.0:1784186572.554776:0:5767:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1784186572 00010000:00010000:3.0:1784186572.554783:0:5767:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 9 pid: 6581 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.554815:0:5767:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 9 pid: 6581 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.554838:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d19ea8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ce expref: 9 pid: 6581 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.554854:0:5767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784186572.554859:0:5767:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784186572.554865:0:5767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.554875:0:5767:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.554910:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186572.554971:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2357:x1870854915971456:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 238us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186572.554979:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 76 00010000:00010000:0.0:1784186572.555034:0:11903:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.555044:0:11903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.555069:0:11903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.555077:0:11903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.555085:0:11903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.555093:0:11903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ece00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186572.555097:0:11903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.555106:0:11903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.555130:0:11903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.555137:0:11903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ec84127/0x55bc3e8c99d19ee7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186572.555181:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915971200:12345-192.168.201.31@tcp:1:lfs.0 Request processed in 17369us (17568us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186572.555190:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:2.0:1784186572.558191:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186572.558291:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915971712 00000100:00100000:0.0:1784186572.558301:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915971712 00000100:00100000:0.0:1784186572.558787:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 56 00000100:00100000:0.0:1784186572.558800:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89b9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+43:11562:x1870854915971712:12345-192.168.201.31@tcp:35:lfs.0 00000004:00010000:0.0:1784186572.558866:0:5785:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19ed9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767e3 expref: 43 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784186572.559132:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1784186572.559177:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1784186572.559836:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1784186572.559897:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.559913:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c0 expref: 47 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.559922:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.559979:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c0 expref: 47 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.559994:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c0 expref: 47 pid: 5783 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186572.560012:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001284700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5785:1870854937980544:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186572.560227:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd629ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186572.565016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.565091:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915971840 00000100:00100000:3.0:1784186572.565100:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915971840 00010000:00010000:3.0:1784186572.565139:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e93 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c0 expref: 48 pid: 5783 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.565184:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:3.0:1784186572.565194:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+48:2356:x1870854915971840:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186572.565226:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186572.565234:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e93 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c0 expref: 48 pid: 5783 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.565247:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c0 expref: 48 pid: 5783 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.565270:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:3.0:1784186572.565275:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.565285:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.565292:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.565311:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186572.565379:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+48:2356:x1870854915971840:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 186us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186572.565387:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 77 00010000:00010000:2.0:1784186572.568847:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d19e93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767c0 expref: 47 pid: 5783 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186572.568876:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001284700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5785:1870854937980544:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186572.568903:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.568914:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.568920:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784186572.569052:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1784186572.569275:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1784186572.569733:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5785:1870854937980672:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784186572.569801:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186572.569930:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc3054000 going to sleep for 11 seconds 00000100:00100000:3.0:1784186572.569971:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937980672 00000100:00100000:3.0:1784186572.569977:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937980672 00000100:00100000:3.0:1784186572.570056:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784186572.570066:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe5578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1870854937980672:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784186572.570144:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe5578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1870854937980672:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186572.570152:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784186572.570216:0:5785:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1784186572.570222:0:5785:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1784186572.570236:0:5785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b9ec576ea00, transno 4294967307 00000100:00100000:2.0:1784186572.570253:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5785:1870854937980672:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784186572.571020:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1784186572.571078:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5785:1870854937980800:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784186572.571122:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186572.571311:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5452f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784186572.571339:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937980800 00000100:00100000:0.0:1784186572.571344:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937980800 00000100:00100000:0.0:1784186572.571372:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784186572.571379:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5785:x1870854937980800:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784186572.571868:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5785:x1870854937980800:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 487us (743us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1784186572.571876:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784186572.571944:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fe5578700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5785:1870854937980800:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784186572.571990:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1784186572.572027:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.572037:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.572044:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.572050:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.572054:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.572062:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.572078:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186572.572080:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784186572.572085:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.572090:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19eee lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784186572.572238:0:5785:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784186572.572328:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1784186572.572338:0:5785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351293896133ns, next at 352293894025ns, rc = 0 00000001:00080000:2.0:1784186572.572344:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1784186572.572374:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186572.572377:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784186572.572384:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d19ed9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767e3 expref: 51 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186572.572801:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89b9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+50:11562:x1870854915971712:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 14004us (14621us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1784186572.572812:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 56 00000020:00080000:2.0:1784186572.572816:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784186572.575207:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.575283:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915971968 00000100:00100000:2.0:1784186572.575292:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915971968 00000100:00100000:2.0:1784186572.575375:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 203 00000100:00100000:2.0:1784186572.575385:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+50:11562:x1870854915971968:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186572.575408:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186572.575575:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19ef5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767ea expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.575640:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19ef5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ea expref: 51 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.575656:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19ef5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ea expref: 51 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.575675:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:2.0:1784186572.575678:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784186572.575694:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d200, rc 0) 00000100:00100000:2.0:1784186572.575785:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+51:11562:x1870854915971968:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 401us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186572.575792:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 203 00000100:00100000:0.0:1784186572.578923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186572.579021:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915972224 00000100:00100000:1.0:1784186572.579044:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915972224 00000100:00100000:1.0:1784186572.579106:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:1.0:1784186572.579116:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+51:11562:x1870854915972224:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1784186572.579361:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+52:11562:x1870854915972224:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 246us (448us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1784186572.579369:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 57 00000100:00100000:3.0:1784186572.661564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186572.661713:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915972352 00000100:00100000:0.0:1784186572.661725:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915972352 00000100:00100000:0.0:1784186572.661789:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 204 00000100:00100000:0.0:1784186572.661799:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+52:11572:x1870854915972352:12345-192.168.201.31@tcp:34:lfs.0 00010000:00010000:0.0:1784186572.661877:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19efc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.661897:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19efc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.661926:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19efc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.661944:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.661952:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.661958:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662055:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19f0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662062:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662069:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784186572.662113:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662127:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19efc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662133:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19efc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662141:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19efc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662157:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fba00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186572.662162:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19efc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662170:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19efc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662184:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:0.0:1784186572.662187:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186572.662191:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19efc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662197:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19efc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662211:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662217:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662223:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662229:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186572.662231:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662237:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662254:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fd011a400) 00010000:00010000:0.0:1784186572.662257:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186572.662260:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662266:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662281:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19f0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662287:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19f0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662292:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19f0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662297:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186572.662300:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19f0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662305:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19f0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662313:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:0.0:1784186572.662316:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186572.662319:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19f0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.662324:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa800/0x55bc3e8c99d19f0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186572.662421:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+52:11572:x1870854915972352:12345-192.168.201.31@tcp:34:lfs.0 Request processed in 621us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186572.662497:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 204 00000100:00100000:3.0:1784186572.723241:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186572.723362:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915972608 00000100:00100000:1.0:1784186572.723372:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915972608 00000100:00100000:1.0:1784186572.723498:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 205 00000100:00100000:1.0:1784186572.723706:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+52:11575:x1870854915972608:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1784186572.723730:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186572.723752:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19f11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767f1 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.723821:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19f18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.723836:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.723848:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.723863:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.723869:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.723876:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724017:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19f26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724025:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724032:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186572.724040:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1784186572.724135:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19f18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724143:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19f18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724150:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724156:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27edc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186572.724160:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19f18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724167:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19f18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724179:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:1.0:1784186572.724181:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186572.724186:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19f18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724202:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d19f18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724214:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724220:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19f1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724225:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724229:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27eca00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186572.724231:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724237:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19f1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724244:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fd1d53700) 00010000:00010000:1.0:1784186572.724246:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186572.724249:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19f1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724255:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eca00/0x55bc3e8c99d19f1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724294:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d19f11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f1 expref: 55 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724308:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f1 expref: 54 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.724321:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186572.724323:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784186572.724326:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ec400, rc 0) 00000100:00100000:1.0:1784186572.724854:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+54:11575:x1870854915972608:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1344us (1621us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1784186572.724862:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 205 00000100:00100000:2.0:1784186572.728363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.728478:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915972736 00000100:00100000:3.0:1784186572.728487:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915972736 00000100:00100000:3.0:1784186572.728554:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 206 00000100:00100000:3.0:1784186572.728565:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+54:11575:x1870854915972736:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:3.0:1784186572.728633:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.728650:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.728662:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.728692:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.728698:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.728706:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.728712:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505e00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186572.728717:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.728723:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.728734:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:3.0:1784186572.728750:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784186572.728755:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.728761:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.728848:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+54:11575:x1870854915972736:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 284us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186572.728856:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 206 00000100:00100000:1.0:1784186572.731467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.731618:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915972992 00000100:00100000:3.0:1784186572.731629:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915972992 00000100:00100000:3.0:1784186572.731699:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:3.0:1784186572.731710:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+54:11575:x1870854915972992:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186572.731982:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+55:11575:x1870854915972992:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 273us (552us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1784186572.731991:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 58 00000100:00100000:1.0:1784186572.817051:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.817123:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915973248 00000100:00100000:2.0:1784186572.817133:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915973248 00000100:00100000:2.0:1784186572.817190:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 207 00000100:00100000:2.0:1784186572.817199:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+55:11585:x1870854915973248:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:2.0:1784186572.817222:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186572.817225:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784186572.817254:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d19eb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767d5 expref: 55 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.817272:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186572.817277:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186572.817289:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19f3b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767f8 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.817398:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.817412:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19f26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f1 expref: 55 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.817421:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.817674:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f1 expref: 55 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.817700:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f1 expref: 55 pid: 5782 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186572.817714:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937980928:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186572.817797:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc28dba80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186572.821830:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.821946:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5783:1870854937980928:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186572.821975:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.822043:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915973376 00000100:00100000:3.0:1784186572.822049:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915973376 00010000:00010000:3.0:1784186572.822090:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f1 expref: 56 pid: 5782 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.822128:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:3.0:1784186572.822137:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+56:2356:x1870854915973376:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186572.822158:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186572.822166:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f1 expref: 56 pid: 5782 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.822203:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f1 expref: 56 pid: 5782 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.822229:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ec400/0x55bc3e8c99d19f26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f1 expref: 56 pid: 5782 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.822244:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:3.0:1784186572.822249:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.822259:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.822267:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.822294:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186572.822361:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+55:2356:x1870854915973376:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 213us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186572.822369:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 78 00010000:00010000:2.0:1784186572.822524:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.822532:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186572.822550:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784186572.822720:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19f3b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f8 expref: 56 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.822737:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f8 expref: 55 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.822746:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:2.0:1784186572.822749:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784186572.822751:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766de00, rc 0) 00000100:00100000:2.0:1784186572.822778:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+55:11585:x1870854915973248:12345-192.168.201.31@tcp:101:bash.0 Request processed in 5580us (5736us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1784186572.822797:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 207 00000100:00100000:1.0:1784186572.825779:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.825850:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915973632 00000100:00100000:3.0:1784186572.825860:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915973632 00000100:00100000:3.0:1784186572.825914:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 208 00000100:00100000:3.0:1784186572.825923:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+55:11585:x1870854915973632:12345-192.168.201.31@tcp:36:bash.0 00010000:00010000:3.0:1784186572.826175:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.826192:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.826216:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784186572.826266:0:7478:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1784186572.826286:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea8df496 reply state 0000000031fcc4e6 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.826294:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784186572.826380:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+58:11585:x1870854915973632:12345-192.168.201.31@tcp:36:bash.0 Request processed in 457us (610us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1784186572.826387:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 208 00000020:00080000:3.0:1784186572.826392:0:7478:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784186572.829054:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.829071:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.829078:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.829084:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505e00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.829088:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.829095:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.829110:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:2.0:1784186572.829113:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.829117:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.829123:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505e00/0x55bc3e8c99d19f50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186572.831046:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.831146:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915973760 00000100:00100000:3.0:1784186572.831158:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915973760 00000100:00100000:3.0:1784186572.831250:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 209 00000100:00100000:3.0:1784186572.831262:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+57:11585:x1870854915973760:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:3.0:1784186572.831288:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186572.831309:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19f57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5767ff expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.831464:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.831480:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f8 expref: 58 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.831489:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.831695:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f8 expref: 58 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.831710:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f8 expref: 58 pid: 5783 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.831726:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6313800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937981056:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186572.831815:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58180 going to sleep for 11 seconds 00000100:00100000:3.0:1784186572.834373:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6313800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937981056:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186572.834404:0:5782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186572.835229:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.835911:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915973888 00000100:00100000:3.0:1784186572.835921:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915973888 00010000:00010000:3.0:1784186572.835963:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f8 expref: 59 pid: 5783 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186572.836007:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:3.0:1784186572.836016:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+59:2357:x1870854915973888:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186572.836033:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186572.836041:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f8 expref: 59 pid: 5783 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.836054:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f8 expref: 59 pid: 5783 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.836095:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d19f42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767f8 expref: 59 pid: 5783 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.836111:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:3.0:1784186572.836116:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.836125:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.836132:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186572.836166:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186572.836226:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+58:2357:x1870854915973888:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 211us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186572.836234:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 79 00010000:00010000:1.0:1784186572.836924:0:5782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.836935:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186572.836987:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1784186572.836992:0:5782:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784186572.837015:0:5782:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.837047:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505a00/0x55bc3e8c99d19f57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ff expref: 58 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.837063:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ff expref: 57 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.837087:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186572.837090:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784186572.837093:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505600, rc 0) 00000100:00100000:1.0:1784186572.837141:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+57:11585:x1870854915973760:12345-192.168.201.31@tcp:101:bash.0 Request processed in 5881us (6105us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186572.837148:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 209 00000100:00100000:3.0:1784186572.841643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186572.841762:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915974144 00000100:00100000:0.0:1784186572.841774:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915974144 00000100:00100000:0.0:1784186572.841837:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 59 00000100:00100000:0.0:1784186572.841848:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+57:11585:x1870854915974144:12345-192.168.201.31@tcp:35:bash.0 00000100:00100000:0.0:1784186572.842140:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+58:11585:x1870854915974144:12345-192.168.201.31@tcp:35:bash.0 Request processed in 293us (508us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1784186572.842149:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 59 00010000:00010000:0.0:1784186572.861720:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186572.927345:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186572.927485:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915974272 00000100:00100000:0.0:1784186572.927496:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915974272 00000100:00100000:0.0:1784186572.927567:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 210 00000100:00100000:0.0:1784186572.927580:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+58:11591:x1870854915974272:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186572.927606:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186572.927631:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576806 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.927699:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19f6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.927715:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.927728:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186572.927825:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1784186572.927830:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186572.927855:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.927883:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576806 expref: 60 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.927904:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19f6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576806 expref: 59 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.927914:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:0.0:1784186572.927917:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784186572.927921:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fba00, rc 0) 00000100:00100000:0.0:1784186572.927998:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11591:x1870854915974272:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 420us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186572.928007:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 210 00000100:00100000:3.0:1784186572.932798:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.932904:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915974400 00000100:00100000:2.0:1784186572.932927:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915974400 00000100:00100000:2.0:1784186572.932989:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 211 00000100:00100000:2.0:1784186572.932998:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11591:x1870854915974400:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186572.933020:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186572.933056:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19f73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57680d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933139:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19f7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933155:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19f7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933169:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19f7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933185:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19f81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933191:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933197:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933332:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19f88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933340:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933347:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186572.933384:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784186572.933389:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186572.933408:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933439:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19f88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933484:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19f7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933491:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19f7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933498:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19f7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933513:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766dc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.933518:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19f7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933526:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19f7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933538:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186572.933541:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.933545:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19f7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933551:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19f7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933564:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933570:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19f81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933581:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19f81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933587:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186572.933589:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19f81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933596:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19f81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933605:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186572.933607:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186572.933610:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19f81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933616:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19f81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933642:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d19f73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57680d expref: 61 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933655:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19f88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57680d expref: 60 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.933663:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:2.0:1784186572.933665:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186572.933668:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d400, rc 0) 00000100:00100000:2.0:1784186572.933732:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+60:11591:x1870854915974400:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 735us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186572.933748:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 211 00000100:00100000:3.0:1784186572.940397:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186572.940489:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186572.940626:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915974656 00000100:00100000:1.0:1784186572.940638:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915974656 00000100:00100000:1.0:1784186572.940704:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:1.0:1784186572.940713:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+60:2357:x1870854915974656:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186572.940729:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186572.940755:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19f88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57680d expref: 60 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.940774:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186572.940779:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186572.940847:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+59:2357:x1870854915974656:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 135us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186572.940855:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:0.0:1784186572.941161:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915974784 00000100:00100000:0.0:1784186572.941166:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915974784 00000100:00100000:0.0:1784186572.941208:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 212 00000100:00100000:0.0:1784186572.941216:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11591:x1870854915974784:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186572.941233:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186572.941249:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576814 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.941343:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.941375:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ff expref: 60 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.941383:0:7478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.941416:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ff expref: 60 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.941477:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ff expref: 60 pid: 5782 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186572.941491:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001285500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937981184:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186572.941725:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd629ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186572.946529:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.946706:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915974912 00000100:00100000:2.0:1784186572.946716:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915974912 00010000:00010000:2.0:1784186572.946756:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ff expref: 61 pid: 5782 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186572.946803:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:2.0:1784186572.946813:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+61:2357:x1870854915974912:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186572.946828:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186572.946837:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ff expref: 61 pid: 5782 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.946851:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ff expref: 61 pid: 5782 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.946876:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:2.0:1784186572.946882:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.946893:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.946903:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.946923:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186572.946988:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+61:2357:x1870854915974912:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 176us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186572.947013:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 80 00010000:00010000:0.0:1784186572.947730:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505600/0x55bc3e8c99d19f5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ff expref: 60 pid: 5782 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186572.947748:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001285500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937981184:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186572.947769:0:7478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.947778:0:7478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.947783:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186572.947806:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1784186572.947964:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19f8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576814 expref: 61 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.947980:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576814 expref: 60 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.947987:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:0.0:1784186572.947989:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784186572.947993:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fa600, rc 0) 00000100:00100000:0.0:1784186572.948088:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+60:11591:x1870854915974784:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 6872us (7598us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1784186572.948095:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 212 00000100:00100000:3.0:1784186572.952395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186572.952741:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915975168 00000100:00100000:1.0:1784186572.952752:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915975168 00000100:00100000:1.0:1784186572.952821:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1784186572.952831:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe54b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+60:11591:x1870854915975168:12345-192.168.201.31@tcp:103:lfs.0 00010000:00010000:1.0:1784186572.952848:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186572.952872:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19ef5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ea expref: 60 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186572.952904:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186572.952909:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186572.952973:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe54b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11591:x1870854915975168:12345-192.168.201.31@tcp:103:lfs.0 Request processed in 144us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186572.952981:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1784186572.955814:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186572.956156:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915975296 00000100:00100000:2.0:1784186572.956166:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915975296 00000100:00100000:2.0:1784186572.956227:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 213 00000100:00100000:2.0:1784186572.956237:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11591:x1870854915975296:12345-192.168.201.31@tcp:58:lfs.0 00010000:00010000:2.0:1784186572.956368:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.956385:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186572.956396:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784186572.956962:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1784186572.957055:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11591:x1870854915975296:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 818us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186572.957064:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 213 00000100:00100000:2.0:1784186572.960029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186572.960120:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915975424 00000100:00100000:0.0:1784186572.960131:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915975424 00000100:00100000:0.0:1784186572.960194:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 214 00000100:00100000:0.0:1784186572.960205:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+59:11591:x1870854915975424:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186572.960226:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186572.960250:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19fab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57681b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.960315:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.960326:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19fab lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57681b expref: 60 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.960344:0:5784:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.960383:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19fab lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57681b expref: 60 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.960397:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:0.0:1784186572.960401:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784186572.960405:0:5784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19fab lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57681b expref: 60 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186572.960423:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fa400, rc 0) 00000100:00100000:0.0:1784186572.960699:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+60:11591:x1870854915975424:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 494us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186572.960707:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 214 00000100:00100000:0.0:1784186572.991530:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937981312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784186572.991616:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186572.992041:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937981312 00000100:00100000:1.0:1784186572.992050:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937981312 00000100:00100000:1.0:1784186572.992144:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784186572.992156:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefe54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1870854937981312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784186572.992187:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3856662528 00000100:00100000:1.0:1784186572.992251:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefe54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1870854937981312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186572.992259:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784186572.992741:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937981312:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1784186573.826031:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784186573.826040:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186573.826094:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1784186573.826102:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784186573.826230:0:11521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6f85880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937981440:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784186573.826359:0:11521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186573.828842:0:11521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6f85880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937981440:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784186573.831996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186573.832087:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915975552 00000100:00100000:2.0:1784186573.832105:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915975552 00000100:00100000:2.0:1784186573.832196:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 215 00000100:00100000:2.0:1784186573.832206:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+60:11592:x1870854915975552:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784186573.832243:0:5783:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784186573.832389:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+60:11592:x1870854915975552:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 183us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186573.832433:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 215 00000100:00100000:2.0:1784186573.842147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186573.842283:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915975680 00000100:00100000:0.0:1784186573.842293:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915975680 00000100:00100000:0.0:1784186573.842365:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 216 00000100:00100000:0.0:1784186573.842376:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+60:11592:x1870854915975680:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784186573.842506:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19fb2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842524:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19fb2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842537:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19fb2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842574:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19fb9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842581:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842588:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842612:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19fc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842621:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842627:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186573.842664:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784186573.842669:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186573.842681:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842693:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19fb2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842700:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19fb2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842706:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19fb2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842722:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186573.842726:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19fb2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842733:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19fb2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842746:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:0.0:1784186573.842749:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186573.842753:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19fb2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842759:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d19fb2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842773:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842779:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19fb9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842784:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842788:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186573.842790:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842796:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842811:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9b9fd011a400) 00010000:00010000:0.0:1784186573.842813:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186573.842816:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19fb9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842820:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19fb9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842834:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19fc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842839:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19fc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842844:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19fc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842848:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186573.842851:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19fc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842855:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19fc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842861:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:0.0:1784186573.842863:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186573.842866:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19fc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.842870:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19fc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186573.842957:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+60:11592:x1870854915975680:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 Request processed in 582us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186573.842966:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 216 00000100:00100000:3.0:1784186573.845991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186573.846530:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915975936 00000100:00100000:2.0:1784186573.846541:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915975936 00000100:00100000:2.0:1784186573.846614:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 217 00000100:00100000:2.0:1784186573.846623:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+60:11592:x1870854915975936:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186573.846647:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186573.846668:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19fc7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576822 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.846769:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.846784:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.846796:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186573.846805:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784186573.846911:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.846919:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.846926:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.846932:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186573.846954:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.846961:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.846974:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:2.0:1784186573.846977:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784186573.846981:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.846988:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.847033:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19fc7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576822 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.847044:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:2.0:1784186573.847046:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784186573.847049:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19fc7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576822 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.847059:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d200, rc 0) 00000100:00100000:2.0:1784186573.847126:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+61:11592:x1870854915975936:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 504us (1148us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1784186573.847135:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 217 00000100:00100000:1.0:1784186573.858291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186573.858436:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915976064 00000100:00100000:0.0:1784186573.858471:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915976064 00000100:00100000:0.0:1784186573.858535:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 218 00000100:00100000:0.0:1784186573.858546:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+61:11592:x1870854915976064:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784186573.858582:0:5784:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784186573.858680:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+61:11592:x1870854915976064:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 136us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186573.858688:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 218 00000100:00100000:3.0:1784186573.872754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186573.873000:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915976320 00000100:00100000:2.0:1784186573.873013:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915976320 00000100:00100000:2.0:1784186573.873090:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 219 00000100:00100000:2.0:1784186573.873103:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+61:11592:x1870854915976320:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186573.873147:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186573.873152:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784186573.873200:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fba00/0x55bc3e8c99d19f6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576806 expref: 61 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.873223:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186573.873229:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186573.873254:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19fdc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576829 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784186573.873848:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1784186573.874094:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.874110:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.874122:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.874178:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d200/0x55bc3e8c99d19fdc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576829 expref: 63 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.874198:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576829 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.874206:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186573.874210:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186573.874222:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d800, rc 0) 00000100:00100000:2.0:1784186573.874302:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6f87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+62:11592:x1870854915976320:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 1201us (1562us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1784186573.874312:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 219 00000100:00100000:1.0:1784186573.883676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186573.883765:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915976576 00000100:00100000:0.0:1784186573.883775:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915976576 00000100:00100000:0.0:1784186573.883840:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 220 00000100:00100000:0.0:1784186573.883851:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+62:11592:x1870854915976576:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784186573.883917:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186573.883946:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d800/0x55bc3e8c99d19fe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576829 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.883966:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:0.0:1784186573.883977:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784186573.883998:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19ff1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884012:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19ff1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884040:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19ff1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884056:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19ff8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd106309a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884063:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd106309a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884069:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd106309a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884153:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19ff1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884159:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19ff1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884165:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19ff1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884172:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186573.884176:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19ff1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884184:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19ff1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884191:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:0.0:1784186573.884194:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186573.884197:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19ff1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884209:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb400/0x55bc3e8c99d19ff1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884218:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd106309a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884223:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19ff8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd106309a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884229:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd106309a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884235:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186573.884238:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd106309a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884243:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19ff8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd106309a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884250:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd106309a (ffff9b9fd011a400) 00010000:00010000:0.0:1784186573.884252:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186573.884254:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19ff8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd106309a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.884260:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb800/0x55bc3e8c99d19ff8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd106309a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186573.884346:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+61:11592:x1870854915976576:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 496us (680us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784186573.884363:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 220 00010000:00010000:1.0:1784186573.885739:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186573.893218:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186573.893325:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915976704 00000100:00100000:2.0:1784186573.893343:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915976704 00000100:00100000:2.0:1784186573.893424:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 221 00000100:00100000:2.0:1784186573.893435:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+61:11592:x1870854915976704:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186573.893529:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186573.893553:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19fff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576830 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.893591:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.893603:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.893613:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.893709:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d19fff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576830 expref: 63 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.893727:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576830 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.893735:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186573.893738:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784186573.893748:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c600, rc 0) 00000100:00100000:2.0:1784186573.893806:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+62:11592:x1870854915976704:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 373us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186573.893813:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 221 00000100:00100000:2.0:1784186573.899168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186573.899278:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915976960 00000100:00100000:0.0:1784186573.899290:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915976960 00000100:00100000:0.0:1784186573.899370:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 222 00000100:00100000:0.0:1784186573.899382:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+62:11592:x1870854915976960:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784186573.902944:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a00d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.902968:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.902982:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784186573.903831:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1784186573.903844:0:5784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352625402066ns, next at 353625399642ns, rc = 0 00000004:00010000:1.0:1784186573.903936:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b439c7ab reply state 000000007761c2a0 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186573.903947:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784186573.904139:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+64:11592:x1870854915976960:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 4755us (4977us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1784186573.904149:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 222 00010000:00010000:1.0:1784186573.908483:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a00d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.908510:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a00d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.908518:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a00d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.908526:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186573.908531:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a00d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.908538:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a00d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.908556:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:1.0:1784186573.908558:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784186573.908564:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a00d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.908590:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a00d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186573.911811:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186573.912037:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915977088 00000100:00100000:1.0:1784186573.912049:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915977088 00000100:00100000:1.0:1784186573.912123:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 223 00000100:00100000:1.0:1784186573.912134:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+63:11592:x1870854915977088:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784186573.912169:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186573.912195:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d1a014 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576837 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.914548:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d1a014 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576837 expref: 64 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.914576:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d1a014 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576837 expref: 64 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.914603:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:1.0:1784186573.914606:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186573.914611:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ede00, rc 0) 00000100:00100000:1.0:1784186573.914686:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+64:11592:x1870854915977088:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 2553us (2887us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186573.914695:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 223 00000100:00100000:0.0:1784186573.925167:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186573.925598:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915977216 00000100:00100000:2.0:1784186573.925611:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915977216 00000100:00100000:2.0:1784186573.925691:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:2.0:1784186573.925704:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffdbc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2354:x1870854915977216:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1784186573.926049:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffdbc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+10:2354:x1870854915977216:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 347us (896us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1784186573.926058:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00080000:0.0:1784186573.926290:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784186573.934777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186573.934986:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915977472 00000100:00100000:1.0:1784186573.934996:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915977472 00000100:00100000:1.0:1784186573.935057:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:1.0:1784186573.935067:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+64:11592:x1870854915977472:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784186573.935373:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+65:11592:x1870854915977472:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 306us (609us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1784186573.935381:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 60 00000100:00100000:3.0:1784186573.938259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186573.938424:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915977728 00000100:00100000:0.0:1784186573.938434:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915977728 00000100:00100000:0.0:1784186573.938521:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 224 00000100:00100000:0.0:1784186573.938531:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+65:11592:x1870854915977728:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784186573.938651:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+65:11592:x1870854915977728:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 121us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186573.938659:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 224 00000100:00100000:0.0:1784186573.942729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186573.943268:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915977856 00000100:00100000:1.0:1784186573.943278:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915977856 00000100:00100000:1.0:1784186573.943341:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 225 00000100:00100000:1.0:1784186573.943361:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+65:11592:x1870854915977856:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784186573.943385:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186573.943425:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a01b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57683e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.943686:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d1a022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.943704:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d1a022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.943716:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d1a022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186573.943760:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784186573.943779:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d1a022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.943808:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ed600/0x55bc3e8c99d1a01b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57683e expref: 67 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.943828:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d1a022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57683e expref: 66 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186573.943859:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:1.0:1784186573.943861:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784186573.943865:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27eda00, rc 0) 00000100:00100000:1.0:1784186573.943935:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+66:11592:x1870854915977856:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 585us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186573.943944:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 225 00000100:00100000:1.0:1784186573.948872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186573.948958:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915977984 00000100:00100000:0.0:1784186573.948967:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915977984 00000100:00100000:0.0:1784186573.949027:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:0.0:1784186573.949037:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+10:2357:x1870854915977984:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784186573.949055:0:6583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186573.949080:0:6583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000835e1353/0x55bc3e8c99d1a029 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576845 expref: -99 pid: 6583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784186573.949110:0:6583:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5886ce, blocks: 0x1 00010000:00010000:0.0:1784186573.949129:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1784186573.949134:0:6583:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186573.949158:0:6583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000835e1353/0x55bc3e8c99d1a029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576845 expref: 11 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.949179:0:6583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000835e1353/0x55bc3e8c99d1a029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576845 expref: 11 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.949203:0:6583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fae00, rc 0) 00000100:00100000:0.0:1784186573.949281:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+11:2357:x1870854915977984:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 245us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186573.949289:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:2.0:1784186573.955565:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186573.955737:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915978240 00000100:00100000:0.0:1784186573.955749:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915978240 00000100:00100000:0.0:1784186573.955802:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 226 00000100:00100000:0.0:1784186573.955812:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+66:11592:x1870854915978240:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784186573.955925:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+66:11592:x1870854915978240:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 114us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186573.955933:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 226 00000100:00100000:2.0:1784186573.961728:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186573.961824:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915978368 00000100:00100000:0.0:1784186573.961836:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915978368 00000100:00100000:0.0:1784186573.961895:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:0.0:1784186573.961904:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+11:11592:x1870854915978368:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784186573.961924:0:6584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186573.961943:0:6584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57684c expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.961977:0:6584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000835e1353/0x55bc3e8c99d1a029 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576845 expref: 12 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.962000:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186573.962004:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186573.962009:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.962043:0:6584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000835e1353/0x55bc3e8c99d1a029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576845 expref: 12 pid: 6583 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.962056:0:6584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000835e1353/0x55bc3e8c99d1a029 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576845 expref: 12 pid: 6583 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186573.962070:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001286d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6584:1870854937981568:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186573.962175:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd629ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186573.965720:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186573.966000:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001286d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6584:1870854937981568:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186573.966039:0:6584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186573.966062:0:6584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fbe00, rc 0) 00000100:00100000:0.0:1784186573.966132:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+12:11592:x1870854915978368:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 4229us (4414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186573.966141:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:2.0:1784186573.966224:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915978496 00000100:00100000:2.0:1784186573.966231:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915978496 00010000:00010000:2.0:1784186573.966273:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000835e1353/0x55bc3e8c99d1a029 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576845 expref: 12 pid: 6583 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186573.966311:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00100000:2.0:1784186573.966320:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+12:2357:x1870854915978496:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186573.966334:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186573.966360:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000835e1353/0x55bc3e8c99d1a029 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576845 expref: 12 pid: 6583 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.966393:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000835e1353/0x55bc3e8c99d1a029 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576845 expref: 12 pid: 6583 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.966426:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000835e1353/0x55bc3e8c99d1a029 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576845 expref: 12 pid: 6583 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.966500:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186573.966505:0:11003:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186573.966514:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.966524:0:11003:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186573.966557:0:11003:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 11 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186573.966571:0:11003:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11003:1870854937981696:192.168.201.31@tcp:105: 00000100:00100000:2.0:1784186573.966624:0:11003:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc28db180 going to sleep for 11 seconds 00000100:00100000:3.0:1784186573.974707:0:11003:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11003:1870854937981696:192.168.201.31@tcp:105: 00010000:00010000:3.0:1784186573.974739:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186573.974813:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+11:2357:x1870854915978496:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 8492us (9102us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186573.974825:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00100000:3.0:1784186573.979178:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186573.981750:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915978624 00000100:00100000:2.0:1784186573.981765:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915978624 00002000:00100000:2.0:1784186573.981829:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b9ffd8a8000 x1870854915978624/t0(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:29/0 lens 504/0 e 0 to 0 dl 1784186584 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186573.981840:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ffd8a8000 with x1870854915978624 ext(0->12) 00002000:00010000:2.0:1784186573.981862:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9ffd8a8000 00000100:00100000:2.0:1784186573.981907:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:2.0:1784186573.981917:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+11:2354:x1870854915978624:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784186573.982653:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+13:2354:x1870854915978624:12345-192.168.201.31@tcp:4:lhsmtool_posix.0 Request processed in 735us (3482us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1784186573.982663:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00002000:00100000:2.0:1784186573.982672:0:6589:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9b9ffd8a8000 x1870854915978624/t4294967320(0) o4->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:29/0 lens 504/448 e 0 to 0 dl 1784186584 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186573.982680:0:6589:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9b9ffd8a8000 with x1870854915978624 ext(0->12) 00002000:00010000:2.0:1784186573.982685:0:6589:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b9ffd8a8000 00000100:00100000:1.0:1784186573.987505:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186573.987643:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915978752 00000100:00100000:2.0:1784186573.987653:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915978752 00000100:00100000:2.0:1784186573.987721:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 227 00000100:00100000:2.0:1784186573.987731:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+66:11592:x1870854915978752:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1784186574.018906:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937981824:0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.018978:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186574.019064:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186574.019071:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937981952:0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.019099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186574.019132:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937981824 00000100:00100000:3.0:1784186574.019138:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937981824 00000100:00100000:3.0:1784186574.019183:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1784186574.019192:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3306:x1870854937981824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.019256:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3306:x1870854937981824:12345-0@lo:400:kworker.0 Request processed in 64us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186574.019264:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1784186574.019305:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937981952 00000100:00100000:3.0:1784186574.019308:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937981952 00000100:00100000:3.0:1784186574.019343:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784186574.019351:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937981952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.019382:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937981952:12345-0@lo:400:kworker.0 Request processed in 33us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186574.019389:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784186574.019437:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937981952:0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.019468:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937981824:0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.019737:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937982080:0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.019765:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186574.019835:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784186574.019841:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937982208:0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.019870:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186574.019896:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937982208 00000100:00100000:3.0:1784186574.019899:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937982208 00000100:00100000:3.0:1784186574.019933:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784186574.019940:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1870854937982208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.019975:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1870854937982208:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186574.019981:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1784186574.019996:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784186574.020016:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937982208:0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.020032:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937982080 00000100:00100000:3.0:1784186574.020035:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937982080 00000100:00100000:3.0:1784186574.020058:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784186574.020071:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937982080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.020104:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854937982080:12345-0@lo:400:kworker.0 Request processed in 34us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186574.020110:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1784186574.020124:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186574.020140:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854937982080:0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.020323:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1870854937982336:0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.020358:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186574.020492:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186574.020498:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937982464:0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.020522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186574.020547:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937982464 00000100:00100000:3.0:1784186574.020551:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937982464 00000100:00100000:3.0:1784186574.020580:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784186574.020586:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937982464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186574.020602:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937982336 00000100:00100000:1.0:1784186574.020607:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937982336 00000100:00100000:3.0:1784186574.020618:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937982464:12345-0@lo:400:kworker.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186574.020624:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784186574.020630:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00080000:3.0:1784186574.020635:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186574.020636:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870854937982336:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784186574.020638:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186574.020656:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937982464:0@lo:400:kworker.0 00000100:00100000:3.0:1784186574.020665:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1870854937982336:0@lo:400:kworker.0 00000100:00100000:1.0:1784186574.020666:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1870854937982336:12345-0@lo:400:kworker.0 Request processed in 32us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186574.020673:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000001:00080000:0.0:1784186574.048638:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000001:00080000:0.0:1784186574.048677:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1784186574.048684:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1784186574.048724:0:5806:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b9fcd746180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1784186574.048730:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffee2e500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b9fcd746cc0 00000020:00080000:0.0:1784186574.048733:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffee2ed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b9ec6fdec00 00000004:00080000:0.0:1784186574.048756:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1784186574.048771:0:5806:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b9fc3054d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1784186574.048774:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9fcd446100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b9fc3054000 00000020:00080000:0.0:1784186574.048778:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9fcd446400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b9ffe2ae400 00000020:00080000:0.0:1784186574.048816:0:5806:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1784186574.048962:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1784186574.049134:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1784186574.049206:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937982592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784186574.049624:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186574.049756:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784186574.049763:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937982720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1784186574.049785:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186574.049928:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+20:11592:x1870854915978752:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 Request processed in 62195us (62437us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186574.049940:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 227 00000100:00100000:1.0:1784186574.053703:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937982848:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784186574.055140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186574.055335:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937982592 00000100:00100000:3.0:1784186574.055346:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937982592 00000100:00100000:1.0:1784186574.056634:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937982720 00000100:00100000:1.0:1784186574.056646:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937982720 00000100:00100000:1.0:1784186574.056706:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784186574.056715:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1870854937982592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784186574.056748:0:11903:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1784186574.056774:0:11903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.056798:0:11903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19df9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ab expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.056821:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1784186574.056826:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186574.056831:0:11903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.056869:0:11903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ab expref: 12 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.056885:0:11903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ab expref: 12 pid: 6584 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186574.056900:0:11903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec576dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11903:1870854937982976:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186574.056982:0:11903:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186574.057404:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784186574.057428:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1870854937982720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1784186574.057691:0:6581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784186574.057695:0:6581:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1784186574 00002000:00010000:0.0:1784186574.057697:0:6581:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784186574.057700:0:6581:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1784186574 -> 1784186574 00002000:00010000:0.0:1784186574.057703:0:6581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784186574.057771:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3308:x1870854937982720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 350us (7984us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1784186574.057779:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1784186574.057845:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba001285c00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1784186574.057852:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937982720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1784186574.062168:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937982848 00000100:00100000:0.0:1784186574.062181:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937982848 00000100:00100000:0.0:1784186574.062535:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784186574.062546:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854937982848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1784186574.062580:0:6584:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1784186574.062618:0:6584:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5886cc, atime: 0x6a5886cc, ctime: 0x6a5886cc, blocks: 0x1 00010000:00010000:0.0:1784186574.062625:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a03e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.062642:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1784186574.062647:0:6584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186574.062653:0:6584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a03e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.062668:0:6584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a03e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.062678:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a03e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.062686:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a03e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.062705:0:6584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784186574.063574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186574.063655:0:6581:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1784186574.063666:0:6581:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1784186574.064011:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1870854937982848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1466us (8875us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784186574.064029:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784186574.064048:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915978880 00000100:00100000:0.0:1784186574.064055:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915978880 00000100:00100000:0.0:1784186574.064082:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:0.0:1784186574.064090:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+13:2356:x1870854915978880:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1784186574.064145:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186574.064153:0:11501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a03e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.064165:0:11501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186574.064170:0:11501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a03e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.064182:0:11501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a03e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.064350:0:11501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a03e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.064360:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a03e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.064381:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186574.064383:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186574.064385:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186574.065836:0:11903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec576dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11903:1870854937982976:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186574.065864:0:11903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186574.065964:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186574.065986:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915979008 00000100:00100000:1.0:1784186574.065993:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915979008 00010000:00010000:1.0:1784186574.066025:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ab expref: 14 pid: 6584 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186574.066069:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:1.0:1784186574.066079:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+14:2356:x1870854915979008:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186574.066093:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186574.066099:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ab expref: 14 pid: 6584 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.066113:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ab expref: 14 pid: 6584 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.066136:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000882531b1/0x55bc3e8c99d19df9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5767ab expref: 14 pid: 6584 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.066152:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186574.066156:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186574.066163:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.066172:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.066210:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186574.066274:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+13:2356:x1870854915979008:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 197us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186574.066283:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 82 00010000:00010000:1.0:1784186574.066377:0:11903:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.066385:0:11903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.066397:0:11903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.066404:0:11903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.066430:0:11903:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784186574.067048:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3308:x1870854937982592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10331us (17423us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1784186574.067057:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1784186574.068043:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186574.068063:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.068076:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27edc00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186574.068080:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.068090:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.068107:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.068114:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a037 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186574.068132:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186574.068134:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186574.068136:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1784186574.068185:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba001286680/2, rc 0, transno 4294967322 00000100:00100000:0.0:1784186574.070143:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937982592:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1784186574.073437:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ba001285f80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1784186574.073667:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937982848:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1784186574.117938:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1784186574.117956:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1784186574.117964:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1784186574.118126:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2356:x1870854915978880:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 Request processed in 54031us (54551us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186574.118139:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:1.0:1784186574.121896:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186574.122371:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915979264 00000100:00100000:3.0:1784186574.122381:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915979264 00000100:00100000:2.0:1784186574.122872:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 228 00000100:00100000:2.0:1784186574.122883:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+20:11592:x1870854915979264:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784186574.122935:0:7478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186574.122960:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27eda00/0x55bc3e8c99d1a022 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57683e expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.122976:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186574.122981:0:7478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186574.123011:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a045 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.123024:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.123035:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784186574.123770:0:7478:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005376f22e reply state 000000005e79f322 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186574.123786:0:7478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186574.123927:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+21:11592:x1870854915979264:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 1045us (2037us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1784186574.123936:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 228 00000100:00080000:3.0:1784186574.123999:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784186574.125760:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a045 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.125776:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a045 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.125815:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a045 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.125823:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766ce00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186574.125827:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a045 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.125839:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a045 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.125858:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186574.125861:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186574.125866:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a045 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.125876:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a045 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186574.127347:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186574.127643:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915979392 00000100:00100000:3.0:1784186574.127654:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915979392 00000100:00100000:3.0:1784186574.127711:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:3.0:1784186574.127724:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2356:x1870854915979392:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784186574.127954:0:6583:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1784186574.127958:0:6583:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1784186574 -> 1784186573 00002000:00010000:3.0:1784186574.127961:0:6583:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1784186572 00002000:00010000:3.0:1784186574.127963:0:6583:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1784186574 -> 1784186573 00002000:00010000:3.0:1784186574.127964:0:6583:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1784186574.128030:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2356:x1870854915979392:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 310us (691us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1784186574.128039:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 70 00000100:00100000:0.0:1784186574.132980:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186574.133097:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915979648 00000100:00100000:1.0:1784186574.133108:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915979648 00000100:00100000:1.0:1784186574.133203:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 229 00000100:00100000:1.0:1784186574.133212:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+20:11592:x1870854915979648:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1784186574.133284:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.133311:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a006 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576830 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.133317:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.133345:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576830 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.133355:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576830 expref: 20 pid: 5783 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186574.133371:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5784:1870854937983104:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186574.133500:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186574.137695:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5784:1870854937983104:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186574.137726:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186574.139149:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186574.139370:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915979776 00000100:00100000:3.0:1784186574.139378:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915979776 00010000:00010000:3.0:1784186574.139425:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576830 expref: 21 pid: 5783 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186574.139899:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 83 00000100:00100000:2.0:1784186574.139914:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+21:2356:x1870854915979776:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186574.139931:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186574.139940:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576830 expref: 21 pid: 5783 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.139954:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576830 expref: 21 pid: 5783 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.139976:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a006 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576830 expref: 21 pid: 5783 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.140005:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186574.140011:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.140020:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.140027:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.140060:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186574.140119:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001286d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+20:2356:x1870854915979776:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 209us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186574.140128:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 83 00010000:00010000:1.0:1784186574.140206:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.140214:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.140253:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.140260:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.140272:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.140278:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27edc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186574.140282:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.140289:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.140298:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:1.0:1784186574.140301:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784186574.140304:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.140311:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a04c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186574.140363:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+19:11592:x1870854915979648:12345-192.168.201.31@tcp:55:lhsmtool_posix.0 Request processed in 7151us (7393us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784186574.140372:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 229 00000100:00100000:0.0:1784186574.147043:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186574.147433:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915979904 00000100:00100000:1.0:1784186574.147457:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915979904 00000100:00100000:1.0:1784186574.147530:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:1.0:1784186574.147541:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2357:x1870854915979904:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784186574.147598:0:11903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.147623:0:11903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.147651:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186574.147656:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784186574.147661:0:11903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.147697:0:11903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 8 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.147713:0:11903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 8 pid: 6584 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186574.147728:0:11903:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11903:1870854937983232:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186574.147816:0:11903:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186574.151641:0:11903:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11903:1870854937983232:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186574.151647:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00010000:00010000:1.0:1784186574.151675:0:11903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186574.151727:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915980032 00000100:00100000:2.0:1784186574.151734:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915980032 00010000:00010000:2.0:1784186574.151769:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 9 pid: 6584 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186574.151799:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 84 00000100:00100000:2.0:1784186574.151808:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+9:2356:x1870854915980032:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186574.151823:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186574.151970:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 9 pid: 6584 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.151984:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 9 pid: 6584 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.152025:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a030 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57684c expref: 9 pid: 6584 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.152040:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186574.152044:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186574.152050:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.152059:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.152090:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784186574.152114:0:11903:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.152122:0:11903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186574.152145:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2356:x1870854915980032:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 337us (498us total) trans 0 rc 0/0 00010000:00010000:1.0:1784186574.152146:0:11903:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186574.152152:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 84 00010000:00010000:1.0:1784186574.152159:0:11903:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.152166:0:11903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.152173:0:11903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186574.152178:0:11903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.152187:0:11903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.152199:0:11903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.152206:0:11903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a053 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186574.152264:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2357:x1870854915979904:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 Request processed in 4725us (5233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186574.152272:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 71 00000100:00100000:0.0:1784186574.157824:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186574.157947:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915980288 00000100:00100000:3.0:1784186574.157960:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915980288 00000100:00100000:3.0:1784186574.158052:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 230 00000100:00100000:3.0:1784186574.158063:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+19:11592:x1870854915980288:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784186574.158157:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a05a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.158178:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.158189:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.158426:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.158437:0:5782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d1a014 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576837 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.158618:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.158660:0:5782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d1a014 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576837 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.158674:0:5782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d1a014 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576837 expref: 20 pid: 5783 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186574.158689:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937983360:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186574.158807:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186574.164926:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937983360:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186574.164953:0:5782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186574.166135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186574.166238:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915980416 00000100:00100000:2.0:1784186574.166247:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915980416 00010000:00010000:2.0:1784186574.166292:0:11003:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d1a014 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576837 expref: 21 pid: 5783 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186574.166379:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 85 00000100:00100000:2.0:1784186574.166389:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+21:2356:x1870854915980416:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186574.166417:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186574.166425:0:11003:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d1a014 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576837 expref: 21 pid: 5783 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.166661:0:11003:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d1a014 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576837 expref: 21 pid: 5783 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.166689:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27ede00/0x55bc3e8c99d1a014 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576837 expref: 21 pid: 5783 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.166707:0:11003:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:2.0:1784186574.166712:0:11003:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.166721:0:11003:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.166729:0:11003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.166759:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186574.166806:0:5782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.166816:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186574.166859:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+20:2356:x1870854915980416:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 470us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186574.166866:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 85 00000001:00080000:3.0:1784186574.167017:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1784186574.167157:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1784186574.167188:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1784186574.167261:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5782:1870854937983488:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784186574.167298:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186574.167323:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58240 going to sleep for 11 seconds 00000100:00100000:0.0:1784186574.167344:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937983488 00000100:00100000:0.0:1784186574.167350:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937983488 00000100:00100000:0.0:1784186574.167670:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784186574.167678:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5782:x1870854937983488:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784186574.167806:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5782:x1870854937983488:12345-0@lo:1000:mdt00_000.0 Request processed in 128us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186574.167813:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784186574.167872:0:5782:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1784186574.167877:0:5782:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1784186574.167896:0:5782:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba001285c00, transno 4294967321 00000100:00100000:1.0:1784186574.167958:0:5782:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9ba001286680 x1870854937982592/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784186590 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186574.167971:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5782:1870854937983488:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1784186574.168771:0:5782:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1784186574.168855:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd542d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5782:1870854937983616:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784186574.168901:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186574.169804:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937983616 00000100:00100000:3.0:1784186574.169816:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937983616 00000100:00100000:1.0:1784186574.169823:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784186574.169909:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784186574.169919:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5782:x1870854937983616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784186574.170106:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5782:x1870854937983616:12345-0@lo:1000:mdt00_000.0 Request processed in 188us (1204us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1784186574.170113:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784186574.170624:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd542d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5782:1870854937983616:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1784186574.170666:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170677:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170685:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170692:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186574.170697:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170704:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170721:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fc5142200) 00010000:00010000:1.0:1784186574.170724:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186574.170729:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170736:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a061 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170784:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170791:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170796:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170801:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766dc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186574.170804:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170811:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170819:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186574.170821:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186574.170830:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19fab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57681b expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170843:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19fab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57681b expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170852:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19fab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57681b expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.170886:0:5782:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19fab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57681b expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186574.170911:0:5782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd540000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937983744:192.168.201.31@tcp:105: 00000100:00100000:1.0:1784186574.171024:0:5782:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186574.177948:0:5782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd540000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5782:1870854937983744:192.168.201.31@tcp:105: 00010000:00010000:1.0:1784186574.177982:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.177993:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766dc00/0x55bc3e8c99d19fa4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178029:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a068 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178045:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a068 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178059:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a068 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178070:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a068 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178076:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a068 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178083:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a068 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178088:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27edc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186574.178092:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a068 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178115:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a068 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178128:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186574.178131:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186574.178136:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a068 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178141:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a068 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178151:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178157:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a05a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178164:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a05a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178170:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186574.178173:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a05a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178178:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a05a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178186:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186574.178189:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784186574.178192:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a05a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.178206:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a05a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186574.178436:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+23:11592:x1870854915980288:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 20373us (20622us total) trans 4294967512 rc 0/0 00000040:00080000:3.0:1784186574.178648:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784186574.178653:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186574.179171:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1784186574.179179:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784186574.179318:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 230 00000020:00080000:1.0:1784186574.179323:0:5782:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1784186574.182539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186574.182851:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915980544 00000100:00100000:1.0:1784186574.182862:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915980544 00000100:00100000:1.0:1784186574.182930:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:1.0:1784186574.182941:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+23:11591:x1870854915980544:12345-192.168.201.31@tcp:49:lfs.0 00000100:00100000:1.0:1784186574.183098:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+23:11591:x1870854915980544:12345-192.168.201.31@tcp:49:lfs.0 Request processed in 158us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186574.183105:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 61 00000100:00100000:0.0:1784186574.186318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186574.186745:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915980800 00000100:00100000:1.0:1784186574.186754:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915980800 00000100:00100000:1.0:1784186574.186816:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 62 00000100:00100000:1.0:1784186574.186827:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+23:11592:x1870854915980800:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784186574.186924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000004:00080000:1.0:1784186574.187745:0:5786:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784186574.187827:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1784186574.187862:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a06f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.187874:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a06f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.187882:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a06f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.187895:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a06f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.187899:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a06f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.187903:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a06f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.187921:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784186574.187953:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186574.187960:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a06f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.187966:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27edc00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186574.187969:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a06f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.187977:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a06f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.187988:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9b9fd1d53f00) 00010000:00010000:3.0:1784186574.187991:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784186574.187995:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a06f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186574.188001:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a06f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186574.188006:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+25:11592:x1870854915980800:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 1181us (1697us total) trans 4294967514 rc 0/0 00010000:00010000:3.0:1784186574.188015:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186574.188015:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 62 00000020:00080000:1.0:1784186574.188020:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784186574.188022:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186574.188024:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186574.188116:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915981056 00000100:00100000:0.0:1784186574.188121:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915981056 00000100:00100000:0.0:1784186574.188155:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 231 00000100:00100000:0.0:1784186574.188161:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+25:11591:x1870854915981056:12345-192.168.201.31@tcp:58:lfs.0 00000040:00080000:0.0:1784186574.188306:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1784186574.188336:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+25:11591:x1870854915981056:12345-192.168.201.31@tcp:58:lfs.0 Request processed in 175us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186574.188340:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 231 00000100:00100000:0.0:1784186574.216262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186574.216381:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915981184 00000100:00100000:2.0:1784186574.216412:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915981184 00000100:00100000:2.0:1784186574.216509:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 232 00000100:00100000:2.0:1784186574.216520:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+25:11594:x1870854915981184:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186574.216546:0:7478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186574.216569:0:7478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a076 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576853 expref: -99 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.216633:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a07d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.216649:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a07d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.216662:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a07d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.216677:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.216683:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.216689:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.216961:0:7478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.216974:0:7478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576814 expref: 26 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.216982:0:7478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.217020:0:7478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576814 expref: 26 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.217033:0:7478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576814 expref: 26 pid: 7478 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186574.217046:0:7478:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937983872:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186574.217134:0:7478:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5416780 going to sleep for 11 seconds 00000100:00100000:0.0:1784186574.224730:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186574.225568:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915981440 00000100:00100000:1.0:1784186574.225579:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915981440 00000100:00100000:1.0:1784186574.225638:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:1.0:1784186574.225648:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+27:5569:x1870854915981440:12345-192.168.201.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784186574.225858:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+28:5569:x1870854915981440:12345-192.168.201.31@tcp:35:ldlm_bl.0 Request processed in 210us (1137us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1784186574.225866:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 63 00000100:00100000:2.0:1784186574.226264:0:7478:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7478:1870854937983872:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186574.226292:0:7478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186574.229588:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186574.230608:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915981568 00000100:00100000:1.0:1784186574.230619:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915981568 00010000:00010000:1.0:1784186574.230659:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576814 expref: 28 pid: 7478 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186574.230739:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:1.0:1784186574.230750:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+28:2356:x1870854915981568:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186574.230779:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186574.230786:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576814 expref: 28 pid: 7478 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.230798:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576814 expref: 28 pid: 7478 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.230821:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa600/0x55bc3e8c99d19f96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576814 expref: 28 pid: 7478 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.230837:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186574.230843:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.230851:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.230858:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186574.230889:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186574.230973:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+27:2356:x1870854915981568:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 225us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186574.230988:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 86 00010000:00010000:2.0:1784186574.231046:0:7478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231054:0:7478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186574.231105:0:7478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784186574.231110:0:7478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186574.231128:0:7478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231140:0:7478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231150:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a07d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231166:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a07d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231172:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a07d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231177:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186574.231181:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a07d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231188:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a07d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231196:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:2.0:1784186574.231198:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186574.231201:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a07d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231207:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a07d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231217:0:7478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231222:0:7478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a084 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231228:0:7478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231244:0:7478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766cc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186574.231256:0:7478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231262:0:7478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231270:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9b9fc5142400) 00010000:00010000:2.0:1784186574.231272:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186574.231275:0:7478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a084 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231280:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231313:0:7478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a076 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576853 expref: 27 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231327:0:7478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576853 expref: 26 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186574.231334:0:7478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:2.0:1784186574.231337:0:7478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186574.231339:0:7478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766de00, rc 0) 00000100:00100000:2.0:1784186574.231378:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+26:11594:x1870854915981184:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 14861us (15128us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186574.231386:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 232 00000100:00100000:1.0:1784186574.525682:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937984000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186574.525830:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186574.525946:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937984000 00000100:00100000:3.0:1784186574.525956:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937984000 00000100:00100000:3.0:1784186574.526016:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784186574.526026:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1870854937984000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784186574.526050:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1784186574.526109:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1870854937984000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186574.526117:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784186574.526194:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937984000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784186574.910913:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784186575.125481:0:12399:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784186575.125499:0:12399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784186575.125554:0:12399:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784186575.125561:0:12399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1784186575.232808:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784186575.232819:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186575.232856:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1784186575.232862:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784186575.232981:0:11521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937984128:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784186575.233068:0:11521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186575.244482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186575.244661:0:11521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11521:1870854937984128:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784186575.245324:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915981696 00000100:00100000:1.0:1784186575.245333:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915981696 00000100:00100000:1.0:1784186575.245401:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 233 00000100:00100000:1.0:1784186575.245414:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+26:11606:x1870854915981696:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784186575.245587:0:5783:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784186575.245769:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+26:11606:x1870854915981696:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 357us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186575.245778:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 233 00000100:00100000:3.0:1784186575.261827:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186575.261870:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915981952 00000100:00100000:3.0:1784186575.261880:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915981952 00000100:00100000:3.0:1784186575.261931:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 234 00000100:00100000:3.0:1784186575.261941:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+26:11606:x1870854915981952:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186575.261962:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186575.261985:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a092 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57685a expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186575.262090:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186575.262115:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186575.262128:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186575.262142:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1784186575.262273:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a092 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57685a expref: 29 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186575.262292:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57685a expref: 28 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186575.262301:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:3.0:1784186575.262304:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784186575.262307:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504800, rc 0) 00000100:00100000:3.0:1784186575.262363:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+28:11606:x1870854915981952:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 423us (546us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1784186575.262782:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 234 00000100:00100000:2.0:1784186575.268334:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186575.269047:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186575.269214:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915982208 00000100:00100000:1.0:1784186575.269229:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915982208 00000100:00100000:1.0:1784186575.269296:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 235 00000100:00100000:1.0:1784186575.269306:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+28:11606:x1870854915982208:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784186575.269611:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a0a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186575.269632:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a0a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186575.269645:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a0a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186575.269920:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a0a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186575.269930:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a0a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186575.269955:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a0a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186575.269961:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27edc00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186575.269966:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a0a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186575.269975:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a0a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186575.269988:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186575.269991:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784186575.269996:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a0a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186575.270003:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc27edc00/0x55bc3e8c99d1a0a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186575.270165:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+29:11606:x1870854915982208:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 858us (1837us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1784186575.270176:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 235 00000040:00080000:1.0:1784186575.270296:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784186575.270301:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1784186575.274571:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915982336 00000100:00100000:0.0:1784186575.274590:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915982336 00000100:00100000:0.0:1784186575.274671:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:0.0:1784186575.274683:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe54b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+29:2356:x1870854915982336:12345-192.168.201.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1784186575.275000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186575.275028:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915982592 00000100:00100000:3.0:1784186575.275033:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915982592 00000100:00100000:3.0:1784186575.275065:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 64 00000100:00100000:3.0:1784186575.275073:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe83d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+30:11606:x1870854915982592:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784186575.275311:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe83d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+31:11606:x1870854915982592:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 237us (311us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1784186575.275318:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 64 00010000:00010000:0.0:1784186575.276097:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186575.276137:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504800/0x55bc3e8c99d1a099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57685a expref: 30 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186575.276160:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:0.0:1784186575.276167:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186575.276204:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe54b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+29:2356:x1870854915982336:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 1523us (7161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186575.276213:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000040:00080000:1.0:1784186575.276576:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784186575.276591:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784186575.933627:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186576.216141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186576.216201:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186576.216241:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186576.216280:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186576.216309:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186576.216339:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915983232 00000100:00100000:3.0:1784186576.216362:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915983232 00000100:00100000:3.0:1784186576.216651:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915982848 00000100:00100000:3.0:1784186576.216655:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915982848 00000100:00100000:3.0:1784186576.216684:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 156 00000100:00100000:3.0:1784186576.216696:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915983232:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186576.216775:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2354:x1870854915983232:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 80us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186576.216782:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 156 00000100:00100000:3.0:1784186576.216800:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 157 00000100:00100000:3.0:1784186576.216807:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+29:2354:x1870854915982848:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186576.216837:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+29:2354:x1870854915982848:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 31us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186576.216845:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 157 00000100:00100000:3.0:1784186576.216867:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915982976 00000100:00100000:3.0:1784186576.216871:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915982976 00000100:00080000:0.0:1784186576.216886:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784186576.216892:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186576.216901:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915983104 00000100:00100000:3.0:1784186576.216905:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915983104 00000100:00100000:3.0:1784186576.216948:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00100000:3.0:1784186576.216957:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915982976:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186576.216993:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915982976:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 38us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186576.217018:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00100000:3.0:1784186576.217033:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 95 00000100:00100000:3.0:1784186576.217041:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915983104:12345-192.168.201.31@tcp:400:kworker.0 00000100:00080000:0.0:1784186576.217060:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186576.217081:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915983104:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 39us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186576.217088:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 95 00000100:00100000:2.0:1784186576.217591:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915982720 00000100:00100000:2.0:1784186576.217597:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915982720 00000100:00100000:2.0:1784186576.217647:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 295 00000100:00100000:2.0:1784186576.217655:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915982720:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186576.217692:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915982720:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 38us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186576.217699:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 295 00010000:00010000:2.0:1784186576.958645:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784186577.114804:0:12451:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784186577.114815:0:12451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784186577.114861:0:12451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784186577.114867:0:12451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784186577.332419:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186577.332486:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915983488 00000100:00100000:3.0:1784186577.332496:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915983488 00000100:00100000:3.0:1784186577.332552:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 236 00000100:00100000:3.0:1784186577.332563:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+29:11626:x1870854915983488:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:3.0:1784186577.332586:0:5782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186577.332606:0:5782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576861 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.333043:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a0b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.333059:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.333072:0:5782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a0b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5782 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186577.333083:0:5782:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1784186577.333207:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576861 expref: 32 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.333241:0:5782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a0b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576861 expref: 31 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.333249:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:3.0:1784186577.333252:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784186577.333255:0:5782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504400, rc 0) 00000100:00100000:3.0:1784186577.333949:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+31:11626:x1870854915983488:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 1385us (1537us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1784186577.333958:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 236 00000100:00100000:0.0:1784186577.346225:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186577.346318:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915983616 00000100:00100000:3.0:1784186577.346329:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915983616 00000100:00100000:3.0:1784186577.346394:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 237 00000100:00100000:3.0:1784186577.346404:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+31:11626:x1870854915983616:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:3.0:1784186577.346601:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.347085:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.347099:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.347126:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.347133:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.347165:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.347171:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186577.347175:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.347183:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.347196:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:3.0:1784186577.347199:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784186577.347204:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186577.347210:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504600/0x55bc3e8c99d1a0c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186577.347362:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+31:11626:x1870854915983616:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 948us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186577.347371:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 237 00000100:00100000:0.0:1784186577.535422:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186577.535595:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915983744 00000100:00100000:1.0:1784186577.535615:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915983744 00000100:00100000:1.0:1784186577.535678:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:1.0:1784186577.535689:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2355:x1870854915983744:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:1.0:1784186577.535708:0:11903:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186577.535732:0:11903:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a0ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576868 expref: -99 pid: 11903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784186577.535759:0:11903:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a5886cd, atime: 0x6a5886cc, ctime: 0x6a5886cd, blocks: 0xb 00010000:00010000:1.0:1784186577.535779:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1784186577.535784:0:11903:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186577.535793:0:11903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a0ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576868 expref: 8 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186577.535812:0:11903:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a0ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576868 expref: 8 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186577.535837:0:11903:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ec400, rc 0) 00000100:00100000:1.0:1784186577.536325:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001285500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2355:x1870854915983744:12345-192.168.201.31@tcp:101:cat.0 Request processed in 634us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186577.536334:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 72 00000100:00100000:0.0:1784186577.540418:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186577.540546:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915983872 00000100:00100000:2.0:1784186577.540555:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915983872 00002000:00100000:2.0:1784186577.540602:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9ba001285c00 x1870854915983872/t0(0) o3->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:33/0 lens 488/0 e 0 to 0 dl 1784186588 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186577.540623:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba001285c00 with x1870854915983872 ext(0->4095) 00002000:00010000:2.0:1784186577.540633:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ba001285c00 00000100:00100000:2.0:1784186577.540665:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:2.0:1784186577.540674:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2354:x1870854915983872:12345-192.168.201.31@tcp:3:cat.0 00000100:00100000:2.0:1784186577.540876:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+8:2354:x1870854915983872:12345-192.168.201.31@tcp:3:cat.0 Request processed in 202us (468us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784186577.540884:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00002000:00100000:2.0:1784186577.540890:0:6587:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9ba001285c00 x1870854915983872/t0(0) o3->efb6eb2c-5579-43c6-be4f-310412860e5b@192.168.201.31@tcp:33/0 lens 488/4536 e 0 to 0 dl 1784186588 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784186577.540897:0:6587:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ba001285c00 with x1870854915983872 ext(0->4095) 00002000:00010000:2.0:1784186577.540901:0:6587:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ba001285c00 00000001:00080000:3.0:1784186577.712828:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1784186577.712850:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:0.0:1784186577.981715:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186578.109825:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784186578.109860:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937984256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186578.109943:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186578.110153:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937984256 00000100:00100000:2.0:1784186578.110162:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937984256 00000100:00080000:0.0:1784186578.110287:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784186578.110329:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784186578.110355:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937984256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784186578.110419:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186578.110510:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937984256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186578.110517:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784186578.110592:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1784186578.110599:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1784186578.110626:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba001285f80, transno 4294967310 00000100:00100000:1.0:1784186578.110654:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937984256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784186579.009665:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186579.136728:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937984384:0@lo:400:kworker.0 00000100:00100000:0.0:1784186579.136807:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186579.136852:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937984896:0@lo:400:kworker.0 00000100:00100000:0.0:1784186579.136877:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186579.136902:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784186579.138503:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937984896 00000100:00100000:3.0:1784186579.138516:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937984896 00000100:00100000:3.0:1784186579.138574:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784186579.138584:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937984896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186579.138651:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937984896:12345-0@lo:400:kworker.0 Request processed in 69us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186579.138668:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1784186579.138711:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186579.139050:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937984768:0@lo:400:kworker.0 00000100:00100000:0.0:1784186579.139088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186579.142722:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937984896:0@lo:400:kworker.0 00000100:00100000:0.0:1784186579.142777:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937984512:0@lo:400:kworker.0 00000100:00100000:0.0:1784186579.142847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186579.142888:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937985024:0@lo:400:kworker.0 00000100:00100000:0.0:1784186579.142915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186579.142942:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784186579.142949:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd8a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937984640:0@lo:400:kworker.0 00000100:00100000:0.0:1784186579.142971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186579.143716:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937984384 00000100:00100000:0.0:1784186579.143728:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937984384 00000100:00100000:0.0:1784186579.143770:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1784186579.143780:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937984384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186579.143842:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937984384:12345-0@lo:400:kworker.0 Request processed in 63us (7034us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186579.143850:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1784186579.144030:0:12361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937984768 00000100:00100000:3.0:1784186579.144036:0:12361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937984768 00000100:00100000:3.0:1784186579.144075:0:12361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937985024 00000100:00100000:3.0:1784186579.144078:0:12361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937985024 00000100:00100000:3.0:1784186579.144112:0:12361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784186579.144119:0:12361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937984768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186579.144174:0:12361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937984768:12345-0@lo:400:kworker.0 Request processed in 56us (5085us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186579.144181:0:12361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784186579.144197:0:12361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784186579.144203:0:12361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3306:x1870854937985024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186579.144238:0:12361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3306:x1870854937985024:12345-0@lo:400:kworker.0 Request processed in 35us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186579.144243:0:12361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784186579.144425:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937985024:0@lo:400:kworker.0 00000100:00080000:3.0:1784186579.144478:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186579.150534:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937984512 00000100:00100000:3.0:1784186579.150554:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937984512 00000100:00100000:3.0:1784186579.150624:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937984640 00000100:00100000:3.0:1784186579.150628:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937984640 00000100:00100000:3.0:1784186579.150662:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784186579.150674:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937984512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186579.150777:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937984512:12345-0@lo:400:kworker.0 Request processed in 107us (7929us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186579.150785:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784186579.150817:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784186579.150824:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937984640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186579.150858:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937984640:12345-0@lo:400:kworker.0 Request processed in 34us (7885us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186579.150863:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1784186579.150896:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186579.151230:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd8a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937984640:0@lo:400:kworker.0 00000100:00100000:3.0:1784186579.151242:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937984512:0@lo:400:kworker.0 00000100:00100000:0.0:1784186579.152792:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2f71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937984768:0@lo:400:kworker.0 00000100:00100000:0.0:1784186579.152811:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937984384:0@lo:400:kworker.0 00000020:00080000:0.0:1784186579.211554:0:5806:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1784186579.211648:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:0.0:1784186579.211671:0:5806:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9b9ec503f600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1784186579.211677:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffee2e100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9b9ec503f9c0 00000020:00080000:0.0:1784186579.211680:0:5806:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9b9ffee2e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9b9fc9076400 00000001:00080000:0.0:1784186579.211695:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1784186579.211721:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1784186579.211902:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1784186579.215432:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1784186579.215476:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1784186579.215483:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000040:00080000:0.0:1784186579.389723:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784186579.389743:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784186579.389783:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784186579.389790:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784186579.646361:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186579.646385:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc2e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937985152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784186579.646475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186579.646608:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937985152 00000100:00100000:0.0:1784186579.646618:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937985152 00000100:00100000:0.0:1784186579.646668:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784186579.646677:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937985152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186579.646711:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186579.646762:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937985152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186579.646769:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784186579.647249:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1784186579.647257:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ba001286680, transno 4294967322 00000004:00080000:1.0:1784186579.647278:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1784186579.647328:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc2e6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937985152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784186580.040096:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186581.054777:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186581.337064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186581.337110:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186581.337148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186581.337172:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186581.337198:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186581.337226:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915984512 00000100:00100000:0.0:1784186581.337235:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915984512 00000100:00100000:0.0:1784186581.337301:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915984128 00000100:00100000:0.0:1784186581.337304:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915984128 00000100:00100000:0.0:1784186581.337328:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 161 00000100:00100000:0.0:1784186581.337336:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2356:x1870854915984512:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186581.337407:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2356:x1870854915984512:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 72us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186581.337415:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 161 00000100:00100000:0.0:1784186581.337431:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:0.0:1784186581.337437:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+18:2356:x1870854915984128:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186581.337493:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+18:2356:x1870854915984128:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 55us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186581.337513:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 162 00000100:00100000:0.0:1784186581.337536:0:12361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915984256 00000100:00100000:0.0:1784186581.337540:0:12361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915984256 00000100:00100000:0.0:1784186581.337565:0:12361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915984384 00000100:00100000:0.0:1784186581.337568:0:12361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915984384 00000100:00100000:3.0:1784186581.337736:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915984000 00000100:00100000:3.0:1784186581.337742:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915984000 00000100:00100000:3.0:1784186581.337772:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 297 00000100:00100000:3.0:1784186581.337779:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915984000:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186581.337806:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2356:x1870854915984000:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 27us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186581.337812:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 297 00000100:00100000:0.0:1784186581.337879:0:12361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 98 00000100:00100000:0.0:1784186581.337888:0:12361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915984256:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186581.337915:0:12361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2356:x1870854915984256:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 29us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186581.337921:0:12361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 98 00000100:00100000:0.0:1784186581.337933:0:12361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 99 00000100:00100000:0.0:1784186581.337938:0:12361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2356:x1870854915984384:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186581.337962:0:12361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2356:x1870854915984384:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 24us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186581.337968:0:12361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 99 00000100:00080000:1.0:1784186581.344122:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186581.344133:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784186581.344136:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784186582.079392:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186582.492515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186582.495338:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915984640 00000100:00100000:0.0:1784186582.495353:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915984640 00000100:00100000:0.0:1784186582.495492:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 238 00000100:00100000:0.0:1784186582.495504:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+18:11280:x1870854915984640:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1784186582.496259:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+18:11280:x1870854915984640:12345-192.168.201.31@tcp:60:lhsmtool_posix.0 Request processed in 753us (3752us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186582.496277:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 238 00000100:00100000:0.0:1784186582.499922:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186582.502868:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915984896 00000100:00100000:1.0:1784186582.502885:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915984896 00000100:00100000:1.0:1784186582.502966:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:1.0:1784186582.502980:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+18:11280:x1870854915984896:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784186582.503898:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+19:11280:x1870854915984896:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 916us (3981us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1784186582.503908:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 65 00000100:00100000:1.0:1784186582.888773:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186582.890601:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915985024 00000100:00100000:0.0:1784186582.890618:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915985024 00000100:00100000:0.0:1784186582.890705:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 239 00000100:00100000:0.0:1784186582.890713:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:12077:x1870854915985024:12345-192.168.201.31@tcp:101:lsof.0 00010000:00010000:0.0:1784186582.890731:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186582.890749:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d1a0d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57686f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186582.890800:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a0d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186582.890810:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186582.890820:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186582.890990:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784186582.890994:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186582.891054:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186582.891073:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fac00/0x55bc3e8c99d1a0d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57686f expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186582.891085:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57686f expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186582.891091:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:0.0:1784186582.891093:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784186582.891096:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fbe00, rc 0) 00000100:00100000:0.0:1784186582.895437:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:12077:x1870854915985024:12345-192.168.201.31@tcp:101:lsof.0 Request processed in 4708us (6658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186582.895483:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 239 00010000:00010000:3.0:1784186583.101712:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186583.229834:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784186583.229857:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937985280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186583.229928:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186583.232009:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937985280 00000100:00100000:2.0:1784186583.232024:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937985280 00000100:00100000:2.0:1784186583.232125:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784186583.232137:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937985280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784186583.232183:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186583.232286:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937985280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186583.232295:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784186583.232352:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937985280:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784186583.232429:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784186584.125650:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186584.255138:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937985536:0@lo:400:kworker.0 00000100:00100000:3.0:1784186584.255221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186584.255338:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937986048:0@lo:400:kworker.0 00000100:00100000:3.0:1784186584.255387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186584.255420:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186584.255427:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937985664:0@lo:400:kworker.0 00000100:00100000:3.0:1784186584.255473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186584.255514:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937985536 00000100:00100000:3.0:1784186584.255522:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937985536 00000100:00100000:3.0:1784186584.255584:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937985664 00000100:00100000:3.0:1784186584.255588:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937985664 00000100:00100000:3.0:1784186584.255618:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784186584.255629:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937985536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186584.255689:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937985536:12345-0@lo:400:kworker.0 Request processed in 61us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186584.255696:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784186584.255713:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784186584.255719:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937985664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186584.255747:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937985664:12345-0@lo:400:kworker.0 Request processed in 28us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186584.255753:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1784186584.255772:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186584.255807:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937985664:0@lo:400:kworker.0 00000100:00100000:3.0:1784186584.255818:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937985536:0@lo:400:kworker.0 00000100:00100000:0.0:1784186584.256157:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ba001285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937985792:0@lo:400:kworker.0 00000100:00100000:0.0:1784186584.256202:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186584.256245:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784186584.256252:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937985408:0@lo:400:kworker.0 00000100:00100000:0.0:1784186584.256280:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186584.256304:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd8a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937985920:0@lo:400:kworker.0 00000100:00100000:0.0:1784186584.256335:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186584.256364:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937985920 00000100:00100000:0.0:1784186584.256368:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937985920 00000100:00100000:0.0:1784186584.256404:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784186584.256411:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937985920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186584.256469:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854937985920:12345-0@lo:400:kworker.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186584.256476:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784186584.256496:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937986048 00000100:00100000:0.0:1784186584.256499:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937986048 00000100:00100000:0.0:1784186584.256526:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937985792 00000100:00100000:0.0:1784186584.256541:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937985792 00000100:00100000:0.0:1784186584.256562:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784186584.256568:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937986048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186584.256605:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937986048:12345-0@lo:400:kworker.0 Request processed in 37us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186584.256611:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784186584.256621:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784186584.256640:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937985792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186584.256670:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937985792:12345-0@lo:400:kworker.0 Request processed in 32us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186584.256675:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784186584.256695:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937985408 00000100:00100000:0.0:1784186584.256698:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937985408 00000100:00100000:0.0:1784186584.256724:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1784186584.256730:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937985408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186584.256760:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937985408:12345-0@lo:400:kworker.0 Request processed in 30us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186584.256766:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:0.0:1784186584.256798:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784186584.256802:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186584.256823:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937985408:0@lo:400:kworker.0 00000100:00100000:0.0:1784186584.256833:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd8a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937985920:0@lo:400:kworker.0 00000100:00100000:0.0:1784186584.256841:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ba001285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937985792:0@lo:400:kworker.0 00000100:00100000:0.0:1784186584.256871:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937986048:0@lo:400:kworker.0 00000020:00080000:0.0:1784186584.365115:0:5806:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1784186584.365151:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1784186584.365407:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1784186584.365418:0:5817:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1784186584.766044:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186584.766083:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937986176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186584.766157:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186584.766305:0:11527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937986176 00000100:00100000:0.0:1784186584.766313:0:11527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937986176 00000100:00100000:0.0:1784186584.766373:0:11527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784186584.766383:0:11527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937986176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186584.766420:0:11527:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186584.766492:0:11527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937986176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186584.766511:0:11527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784186584.766566:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937986176:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784186585.150254:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186586.174771:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186586.447695:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186586.447740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186586.447775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186586.447795:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186586.447834:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186586.447922:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915985152 00000100:00100000:0.0:1784186586.447933:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915985152 00000100:00100000:0.0:1784186586.447992:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 299 00000100:00100000:0.0:1784186586.448002:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2355:x1870854915985152:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186586.448078:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2355:x1870854915985152:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 76us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186586.448085:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 299 00000100:00100000:0.0:1784186586.448120:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915985664 00000100:00100000:0.0:1784186586.448124:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915985664 00000100:00100000:0.0:1784186586.448156:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915985280 00000100:00100000:0.0:1784186586.448159:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915985280 00000100:00100000:0.0:1784186586.448179:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:0.0:1784186586.448199:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:2355:x1870854915985664:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186586.448239:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:2355:x1870854915985664:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 41us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186586.448245:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 166 00000100:00100000:0.0:1784186586.448258:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 167 00000100:00100000:0.0:1784186586.448264:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+18:2355:x1870854915985280:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186586.448294:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efb6eb2c-5579-43c6-be4f-310412860e5b+18:2355:x1870854915985280:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 30us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186586.448300:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 167 00000100:00100000:0.0:1784186586.448321:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915985408 00000100:00100000:0.0:1784186586.448324:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915985408 00000100:00100000:0.0:1784186586.448360:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915985536 00000100:00100000:0.0:1784186586.448370:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915985536 00000100:00100000:0.0:1784186586.448397:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:0.0:1784186586.448404:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915985408:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186586.448430:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2355:x1870854915985408:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 27us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186586.448436:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:0.0:1784186586.448478:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 103 00000100:00100000:0.0:1784186586.448483:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2355:x1870854915985536:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186586.448506:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2355:x1870854915985536:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 23us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186586.448512:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 103 00000100:00080000:0.0:1784186586.448635:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784186586.448639:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784186586.448642:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1784186587.071881:0:12657:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:23:05 (1784186585) 00010000:00010000:0.0:1784186587.198002:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186588.222940:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186588.350608:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784186588.350633:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937986304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784186588.350713:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186588.350860:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937986304 00000100:00100000:0.0:1784186588.350869:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937986304 00000100:00100000:0.0:1784186588.350948:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784186588.350958:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ba001285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937986304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784186588.350993:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186588.351054:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ba001285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937986304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186588.351061:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1784186588.351704:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784186588.351748:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937986304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784186589.252527:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186589.381888:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937986432:0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.381963:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186589.382007:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937986944:0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382059:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186589.382086:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784186589.382093:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937986816:0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382116:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186589.382164:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd8a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937986688:0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382186:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186589.382203:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784186589.382208:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937986560:0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186589.382262:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937987072:0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382283:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186589.382314:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937986432 00000100:00100000:0.0:1784186589.382321:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937986432 00000100:00100000:0.0:1784186589.382365:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1784186589.382374:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937986432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382422:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937986432:12345-0@lo:400:kworker.0 Request processed in 49us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186589.382429:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1784186589.382497:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937986944 00000100:00100000:0.0:1784186589.382501:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937986944 00000100:00100000:0.0:1784186589.382535:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937986688 00000100:00100000:0.0:1784186589.382538:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937986688 00000100:00100000:0.0:1784186589.382549:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937986560 00000100:00100000:0.0:1784186589.382552:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937986560 00000100:00100000:0.0:1784186589.382563:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784186589.382569:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937986944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382600:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937986944:12345-0@lo:400:kworker.0 Request processed in 32us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186589.382614:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784186589.382627:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784186589.382633:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937986688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382667:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937986688:12345-0@lo:400:kworker.0 Request processed in 35us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186589.382672:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784186589.382683:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784186589.382689:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937986560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382715:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937986560:12345-0@lo:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186589.382720:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1784186589.382737:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937986816 00000100:00100000:0.0:1784186589.382741:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937986816 00000100:00100000:0.0:1784186589.382760:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937987072 00000100:00100000:0.0:1784186589.382762:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937987072 00000100:00100000:0.0:1784186589.382778:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784186589.382783:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fccc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937986816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382812:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fccc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937986816:12345-0@lo:400:kworker.0 Request processed in 28us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186589.382817:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784186589.382828:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784186589.382833:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937987072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382859:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937987072:12345-0@lo:400:kworker.0 Request processed in 25us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186589.382865:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784186589.382920:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fc9c5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937986816:0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382929:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937986432:0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382938:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937986944:0@lo:400:kworker.0 00000100:00080000:0.0:1784186589.382966:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784186589.382971:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186589.382987:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937986560:0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.382995:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937987072:0@lo:400:kworker.0 00000100:00100000:0.0:1784186589.383004:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd8a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937986688:0@lo:400:kworker.0 00000040:00080000:0.0:1784186589.629766:0:11521:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784186589.629784:0:11521:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784186589.630374:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1784186589.630384:0:11521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784186589.886562:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186589.886598:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937987200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186589.886708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186589.886918:0:11527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937987200 00000100:00100000:0.0:1784186589.886930:0:11527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937987200 00000100:00100000:0.0:1784186589.887016:0:11527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784186589.887027:0:11527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec576df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937987200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186589.887075:0:11527:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186589.887136:0:11527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec576df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937987200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186589.887160:0:11527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784186589.887769:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937987200:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784186590.273054:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186591.293963:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186591.567745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186591.567817:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186591.567850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186591.567873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186591.567901:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186591.567933:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915986304 00000100:00100000:2.0:1784186591.567952:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915986304 00000100:00100000:2.0:1784186591.568020:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915985920 00000100:00100000:2.0:1784186591.568023:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915985920 00000100:00100000:2.0:1784186591.568044:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 171 00000100:00100000:2.0:1784186591.568053:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:2354:x1870854915986304:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186591.568138:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:2354:x1870854915986304:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 86us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186591.568161:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 171 00000100:00100000:2.0:1784186591.568179:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 172 00000100:00100000:2.0:1784186591.568185:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+18:2354:x1870854915985920:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186591.568207:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+18:2354:x1870854915985920:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 22us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186591.568212:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 172 00000100:00100000:2.0:1784186591.568228:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915986048 00000100:00100000:2.0:1784186591.568231:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915986048 00000100:00100000:2.0:1784186591.568253:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915986176 00000100:00100000:2.0:1784186591.568255:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915986176 00000100:00100000:2.0:1784186591.568274:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 106 00000100:00100000:2.0:1784186591.568281:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2354:x1870854915986048:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186591.568312:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2354:x1870854915986048:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 32us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186591.568318:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 106 00000100:00100000:2.0:1784186591.568328:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00100000:2.0:1784186591.568333:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915986176:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186591.568350:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2354:x1870854915986176:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 17us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186591.568356:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00080000:2.0:1784186591.568367:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784186591.568371:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784186591.568374:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186591.569293:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915985792 00000100:00100000:3.0:1784186591.569304:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915985792 00000100:00100000:3.0:1784186591.569404:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 301 00000100:00100000:3.0:1784186591.569414:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915985792:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186591.569554:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2354:x1870854915985792:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 141us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186591.569562:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 301 00000100:00100000:2.0:1784186591.875147:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186591.875488:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915986560 00000100:00100000:1.0:1784186591.875503:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915986560 00000100:00100000:1.0:1784186591.875573:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:1.0:1784186591.875584:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+18:12299:x1870854915986560:12345-192.168.201.31@tcp:35:umount.0 00000100:00100000:1.0:1784186591.876295:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+19:12299:x1870854915986560:12345-192.168.201.31@tcp:35:umount.0 Request processed in 710us (1160us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1784186591.876306:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 66 00000100:00100000:1.0:1784186591.879035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186591.879146:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915986816 00000100:00100000:2.0:1784186591.879171:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915986816 00000100:00100000:2.0:1784186591.879242:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:2.0:1784186591.879253:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+19:12299:x1870854915986816:12345-192.168.201.31@tcp:35:umount.0 00000100:00100000:2.0:1784186591.879657:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+20:12299:x1870854915986816:12345-192.168.201.31@tcp:35:umount.0 Request processed in 404us (632us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1784186591.879665:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 67 00000100:00100000:2.0:1784186591.889605:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186591.891840:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915987072 00000100:00100000:1.0:1784186591.891859:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915987072 00000100:00100000:1.0:1784186591.891943:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:1.0:1784186591.891955:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc89b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+20:12299:x1870854915987072:12345-192.168.201.31@tcp:35:umount.0 00000100:00100000:1.0:1784186591.892473:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc89b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+21:12299:x1870854915987072:12345-192.168.201.31@tcp:35:umount.0 Request processed in 487us (2846us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1784186591.892493:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 68 00000100:00100000:0.0:1784186591.901893:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186591.917470:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915987328 00000100:00100000:3.0:1784186591.917498:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915987328 00000100:00100000:3.0:1784186591.917576:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:3.0:1784186591.917587:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+21:12299:x1870854915987328:12345-192.168.201.31@tcp:35:umount.0 00000100:00100000:3.0:1784186591.917974:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efb6eb2c-5579-43c6-be4f-310412860e5b+22:12299:x1870854915987328:12345-192.168.201.31@tcp:35:umount.0 Request processed in 388us (16092us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1784186591.917984:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 69 00000100:00100000:0.0:1784186591.923034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186591.923080:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186591.923107:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186591.923180:0:11903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915987712 00000100:00100000:2.0:1784186591.923201:0:11903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915987712 00000100:00100000:2.0:1784186591.923258:0:11903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:2.0:1784186591.923270:0:11903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6313100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2353:x1870854915987712:12345-192.168.201.31@tcp:9:umount.0 00000020:00000080:2.0:1784186591.923306:0:11903:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d19690 00000020:00010000:2.0:1784186591.923315:0:11903:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b9fd10ec000: total 0 00000100:00080000:2.0:1784186591.923319:0:11903:0:(import.c:65:import_set_state_nolock()) ffff9b9fd10ee800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784186591.923359:0:11903:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1784186591.924061:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915987840 00000100:00100000:1.0:1784186591.924068:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915987840 00000100:00100000:0.0:1784186591.924135:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186591.924162:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915988096 00000100:00100000:0.0:1784186591.924166:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915988096 00000100:00100000:0.0:1784186591.924205:0:11003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915987968 00000100:00100000:0.0:1784186591.924208:0:11003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915987968 00000100:00100000:0.0:1784186591.924226:0:11003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:0.0:1784186591.924233:0:11003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+15:2355:x1870854915988096:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784186591.924247:0:11003:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784186591.924251:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:1.0:1784186591.924257:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+15:2355:x1870854915987968:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186591.924264:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186591.924268:0:11003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9129000/0x55bc3e8c99d19364 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764c5 expref: 15 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.924272:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc766c200/0x55bc3e8c99d190b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763c2 expref: 15 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.924287:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784186591.924287:0:11003:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186591.924342:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+13:2355:x1870854915987968:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 85us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186591.924349:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:1.0:1784186591.924366:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:1.0:1784186591.924372:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6313b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:2355:x1870854915987840:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186591.924379:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186591.924387:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27ec800/0x55bc3e8c99d19150 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5763fa expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.924395:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00010000:3.0:1784186591.931043:0:5771:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b9fd10ec000: total 0 00010000:00010000:3.0:1784186591.931128:0:5771:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b9fd10ec000, canceled 0 locks, left on hash table 2. 00000100:00100000:0.0:1784186591.931349:0:11003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:2355:x1870854915988096:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 7110us (8234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186591.931361:0:11003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:1.0:1784186591.932883:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6313b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2355:x1870854915987840:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 8497us (9788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186591.932896:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00010000:00010000:3.0:1784186591.933172:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006200421a/0x55bc3e8c99d19a2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57669a expref: 5 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.933983:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a0ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576868 expref: 4 pid: 11903 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.934020:0:5771:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b9fd10ec000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1784186591.934050:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186591.934053:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186591.934054:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186591.934147:0:11903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6313100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:efb6eb2c-5579-43c6-be4f-310412860e5b+2:2353:x1870854915987712:12345-192.168.201.31@tcp:9:umount.0 Request processed in 10877us (11119us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186591.934158:0:11903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 73 00000100:00100000:2.0:1784186591.950288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186591.950511:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915988224 00000100:00100000:0.0:1784186591.950522:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915988224 00000100:00100000:0.0:1784186591.950602:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 74 00000100:00100000:0.0:1784186591.950614:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+5:2353:x1870854915988224:12345-192.168.201.31@tcp:9:umount.0 00000020:00000080:0.0:1784186591.950646:0:6583:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d19428 00000100:00080000:0.0:1784186591.950655:0:6583:0:(import.c:65:import_set_state_nolock()) ffff9b9fd10ed800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784186591.950707:0:6583:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1784186591.950996:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+2:2353:x1870854915988224:12345-192.168.201.31@tcp:9:umount.0 Request processed in 384us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186591.951005:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 74 00010000:00010000:3.0:1784186591.951635:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186591.971867:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186591.972046:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915989248 00000100:00100000:2.0:1784186591.972057:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915989248 00000100:00100000:2.0:1784186591.972130:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 240 00000100:00100000:2.0:1784186591.972139:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+22:2353:x1870854915989248:12345-192.168.201.31@tcp:39:umount.0 00000020:00000080:2.0:1784186591.972175:0:5783:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d190c4 00000020:00010000:2.0:1784186591.972191:0:5783:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b9fef869800: total 0 00000100:00080000:2.0:1784186591.972195:0:5783:0:(import.c:65:import_set_state_nolock()) ffff9b9ec6816000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784186591.972226:0:5783:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1784186591.972984:0:5770:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b9fef869800: total 0 00010000:00010000:1.0:1784186591.973039:0:5770:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b9fef869800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1784186591.973074:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:1.0:1784186591.973077:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784186591.973087:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc9129a00/0x55bc3e8c99d196eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5765c1 expref: 21 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973132:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b9fc7718f00) 00010000:00010000:1.0:1784186591.973136:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784186591.973140:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505400/0x55bc3e8c99d1938e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764d3 expref: 20 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973172:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:1.0:1784186591.973174:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784186591.973178:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda505c00/0x55bc3e8c99d19d89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57678f expref: 19 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973191:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9b9fc5142800) 00010000:00010000:1.0:1784186591.973194:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784186591.973197:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d600/0x55bc3e8c99d193fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764ef expref: 18 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973212:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186591.973222:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186591.973227:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa400/0x55bc3e8c99d19fab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57681b expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973241:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9b9fc5142100) 00010000:00010000:1.0:1784186591.973244:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784186591.973247:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766da00/0x55bc3e8c99d19aaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766bd expref: 16 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973261:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:1.0:1784186591.973263:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186591.973267:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1990d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57664d expref: 15 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973280:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:1.0:1784186591.973282:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186591.973285:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c800/0x55bc3e8c99d193aa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764da expref: 14 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973298:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:1.0:1784186591.973300:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784186591.973304:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504c00/0x55bc3e8c99d19a8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5766b6 expref: 13 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973315:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186591.973318:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784186591.973321:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504400/0x55bc3e8c99d1a0b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576861 expref: 12 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973347:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:1.0:1784186591.973349:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784186591.973353:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc0031000/0x55bc3e8c99d199ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576685 expref: 11 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973364:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9b9fc7718300) 00010000:00010000:1.0:1784186591.973367:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784186591.973370:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fda504200/0x55bc3e8c99d19a17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576693 expref: 10 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973386:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9b9fc5142700) 00010000:00010000:1.0:1784186591.973388:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784186591.973392:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a08b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576853 expref: 9 pid: 7478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186591.973404:0:5770:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b9fef869800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1784186591.973417:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186591.973419:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186591.973421:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186591.974047:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd8a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efb6eb2c-5579-43c6-be4f-310412860e5b+7:2353:x1870854915989248:12345-192.168.201.31@tcp:39:umount.0 Request processed in 1903us (2184us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1784186591.974059:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 240 00010000:00010000:1.0:1784186592.317754:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784186593.034073:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00000020:00000080:2.0:1784186593.034087:0:6607:0:(genops.c:906:class_export_put()) final put ffff9b9fd10eb000/efb6eb2c-5579-43c6-be4f-310412860e5b 00000020:00000080:2.0:1784186593.034149:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fd10eb000/efb6eb2c-5579-43c6-be4f-310412860e5b for lustre-OST0000 00000020:00000080:2.0:1784186593.034412:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9fd10ed800 for lustre-OST0000 00010000:00010000:3.0:1784186593.346377:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186593.470744:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937987328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186593.470852:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186593.471053:0:6585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937987328 00000100:00100000:3.0:1784186593.471064:0:6585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937987328 00000100:00100000:3.0:1784186593.471167:0:6585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784186593.471180:0:6585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937987328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784186593.471227:0:6585:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186593.471282:0:6585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854937987328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186593.471290:0:6585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784186593.471489:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fed9f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854937987328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784186593.471621:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784186594.363154:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186594.363210:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186594.363257:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186594.363422:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915989376 00000100:00100000:2.0:1784186594.363437:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915989376 00000100:00100000:2.0:1784186594.363560:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915989632 00000100:00100000:2.0:1784186594.363563:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915989632 00000100:00100000:2.0:1784186594.363578:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915989504 00000100:00100000:2.0:1784186594.363580:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915989504 00000100:00100000:2.0:1784186594.363598:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:2.0:1784186594.363610:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+12:2354:x1870854915989376:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186594.363635:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186594.363677:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d19196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57640f expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186594.363704:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186594.363790:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+11:2354:x1870854915989376:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 181us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186594.363799:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:2.0:1784186594.363818:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:2.0:1784186594.363825:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+10:2354:x1870854915989632:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186594.363833:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186594.363843:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc766ca00/0x55bc3e8c99d1935d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5764be expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186594.363863:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186594.363884:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+9:2354:x1870854915989632:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 61us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186594.363891:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:2.0:1784186594.363903:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:2.0:1784186594.363910:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+8:2354:x1870854915989504:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186594.363917:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186594.363926:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9128e00/0x55bc3e8c99d1919d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576439 expref: 8 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186594.363934:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186594.363952:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+7:2354:x1870854915989504:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 43us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186594.363958:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00010000:00010000:2.0:1784186594.365678:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186594.380098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186594.380354:0:7478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915989888 00000100:00100000:2.0:1784186594.380368:0:7478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915989888 00000100:00100000:2.0:1784186594.380517:0:7478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 241 00000100:00100000:2.0:1784186594.380530:0:7478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+6:2353:x1870854915989888:12345-192.168.201.31@tcp:39:umount.0 00000020:00000080:2.0:1784186594.380582:0:7478:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d191ab 00000020:00010000:2.0:1784186594.380592:0:7478:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b9fc2e9d000: total 0 00000100:00080000:2.0:1784186594.380597:0:7478:0:(import.c:65:import_set_state_nolock()) ffff9b9fc2e9c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784186594.380634:0:7478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1784186594.380940:0:7478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49150bba-27c4-40e0-9c9a-350e9b02ab4e+5:2353:x1870854915989888:12345-192.168.201.31@tcp:39:umount.0 Request processed in 411us (868us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1784186594.380970:0:7478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 241 00000020:00010000:3.0:1784186594.381180:0:5771:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b9fc2e9d000: total 0 00010000:00010000:3.0:1784186594.381186:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186594.381240:0:5771:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b9fc2e9d000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784186594.381287:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:3.0:1784186594.381291:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186594.381303:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a0d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57686f expref: 4 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186594.381331:0:5771:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b9fc2e9d000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1784186594.381342:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186594.381345:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186594.381347:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784186594.383509:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186594.402542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186594.402666:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915990144 00000100:00100000:2.0:1784186594.402683:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915990144 00000100:00100000:2.0:1784186594.402774:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 302 00000100:00100000:2.0:1784186594.402788:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+7:2353:x1870854915990144:12345-192.168.201.31@tcp:251:umount.0 00000020:00000080:2.0:1784186594.402856:0:5774:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d190a1 00000020:00010000:2.0:1784186594.402866:0:5774:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b9ffdf09000: total 0 00000100:00080000:2.0:1784186594.402872:0:5774:0:(import.c:65:import_set_state_nolock()) ffff9b9ffdf0a000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784186594.402963:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4228b22-4257-4c36-8c46-fa9ee5db5ed6+3:2353:x1870854915990144:12345-192.168.201.31@tcp:251:umount.0 Request processed in 177us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186594.402972:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 302 00000020:00010000:3.0:1784186594.403580:0:11501:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b9ffdf09000: total 0 00010000:00010000:3.0:1784186594.403639:0:11501:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b9ffdf09000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784186594.403680:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27ec200/0x55bc3e8c99d19157 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576401 expref: 2 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186594.403724:0:11501:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b9ffdf09000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1784186594.403736:0:11501:0:(genops.c:906:class_export_put()) final put ffff9b9ffdf09000/b4228b22-4257-4c36-8c46-fa9ee5db5ed6 00010000:00010000:3.0:1784186594.403753:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186594.403756:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186594.403758:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784186594.403915:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffdf09000/b4228b22-4257-4c36-8c46-fa9ee5db5ed6 for MGS 00000020:00000080:2.0:1784186594.403962:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ffdf0a000 for MGS 00000100:00100000:3.0:1784186594.494379:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937987456:0@lo:400:kworker.0 00000100:00100000:1.0:1784186594.494424:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937987584:0@lo:400:kworker.0 00000100:00100000:3.0:1784186594.494519:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186594.494551:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186594.494622:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937988096:0@lo:400:kworker.0 00000100:00100000:1.0:1784186594.494655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186594.494702:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937987968:0@lo:400:kworker.0 00000100:00100000:3.0:1784186594.494744:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186594.494768:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784186594.494772:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe83d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937987840:0@lo:400:kworker.0 00000100:00100000:3.0:1784186594.494793:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186594.494828:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937987456 00000100:00100000:3.0:1784186594.494835:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937987456 00000100:00100000:3.0:1784186594.494893:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1784186594.494918:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc2fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937987456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186594.495106:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc2fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3309:x1870854937987456:12345-0@lo:400:kworker.0 Request processed in 203us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186594.495116:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1784186594.495465:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937987584 00000100:00100000:0.0:1784186594.495474:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937987584 00000100:00100000:0.0:1784186594.495515:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937987968 00000100:00100000:0.0:1784186594.495518:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937987968 00000100:00100000:0.0:1784186594.495552:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784186594.495561:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937987584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186594.495625:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937987584:12345-0@lo:400:kworker.0 Request processed in 64us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186594.495631:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1784186594.495646:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784186594.495652:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937987968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186594.495681:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854937987968:12345-0@lo:400:kworker.0 Request processed in 30us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186594.495687:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1784186594.495710:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937987712:0@lo:400:kworker.0 00000100:00100000:0.0:1784186594.495744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784186594.495780:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186594.495789:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937987712 00000100:00100000:0.0:1784186594.495793:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937987712 00000100:00100000:0.0:1784186594.495814:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1784186594.495819:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fed9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937987712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186594.495849:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fed9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854937987712:12345-0@lo:400:kworker.0 Request processed in 30us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186594.495855:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:0.0:1784186594.495866:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186594.495899:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854937987712:0@lo:400:kworker.0 00000100:00100000:0.0:1784186594.497526:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937988096 00000100:00100000:0.0:1784186594.497543:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937988096 00000100:00100000:0.0:1784186594.497615:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937987840 00000100:00100000:0.0:1784186594.497619:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937987840 00000100:00100000:0.0:1784186594.497646:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784186594.497655:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937988096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186594.497752:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854937988096:12345-0@lo:400:kworker.0 Request processed in 98us (3096us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186594.497759:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784186594.497773:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784186594.497779:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937987840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186594.497812:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854937987840:12345-0@lo:400:kworker.0 Request processed in 34us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186594.497817:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1784186594.497836:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784186594.498579:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe83d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854937987840:0@lo:400:kworker.0 00000100:00100000:2.0:1784186594.498600:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854937987968:0@lo:400:kworker.0 00000100:00100000:2.0:1784186594.498613:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937987456:0@lo:400:kworker.0 00000100:00100000:1.0:1784186594.501894:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854937988096:0@lo:400:kworker.0 00000100:00100000:1.0:1784186594.501954:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937987584:0@lo:400:kworker.0 00000001:00100000:1.0:1784186594.548026:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00000020:00000080:1.0:1784186594.548038:0:7480:0:(genops.c:906:class_export_put()) final put ffff9b9fd10ec000/efb6eb2c-5579-43c6-be4f-310412860e5b 00000020:00000080:1.0:1784186594.548075:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fd10ec000/efb6eb2c-5579-43c6-be4f-310412860e5b for lustre-OST0001 00000020:00000080:1.0:1784186594.548127:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9fd10ee800 for lustre-OST0001 00000001:00080000:0.0:1784186594.555473:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:0.0:1784186594.555492:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 49150bba-27c4-40e0-9c9a-350e9b02ab4e 00000001:00080000:0.0:1784186594.555499:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1784186594.555501:0:5806:0:(genops.c:906:class_export_put()) final put ffff9b9fc2e9d000/49150bba-27c4-40e0-9c9a-350e9b02ab4e 00000001:00100000:0.0:1784186594.555521:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of efb6eb2c-5579-43c6-be4f-310412860e5b 00000001:00080000:0.0:1784186594.555526:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1784186594.555533:0:5806:0:(genops.c:906:class_export_put()) final put ffff9b9fef869800/efb6eb2c-5579-43c6-be4f-310412860e5b 00000020:00000080:1.0:1784186594.555654:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fc2e9d000/49150bba-27c4-40e0-9c9a-350e9b02ab4e for lustre-MDT0000 00000020:00000080:1.0:1784186594.555720:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fef869800/efb6eb2c-5579-43c6-be4f-310412860e5b for lustre-MDT0000 00000020:00000080:1.0:1784186594.555751:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9fc2e9c000 for lustre-MDT0000 00000020:00000080:1.0:1784186594.555756:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ec6816000 for lustre-MDT0000 00000100:00100000:2.0:1784186595.005857:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937988224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784186595.005942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186595.006110:0:6586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937988224 00000100:00100000:0.0:1784186595.006122:0:6586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937988224 00000100:00100000:0.0:1784186595.006190:0:6586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784186595.006200:0:6586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937988224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186595.006244:0:6586:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186595.006309:0:6586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854937988224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186595.006317:0:6586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1784186595.006426:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854937988224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784186595.391299:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784186596.270762:0:12856:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784186596.305023:0:12856:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784186596.305087:0:12856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186596.305123:0:12856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186596.305130:0:12856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186596.305137:0:12856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186596.305163:0:12856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784186596.305169:0:12856:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784186596.305191:0:12856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784186596.305196:0:12856:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784186596.305202:0:12856:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784186596.305230:0:12856:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeeea000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1784186596.305348:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186596.305355:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.305363:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16a00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:3.0:1784186596.305366:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.305396:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784186596.305404:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186596.305409:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784186596.305411:0:5771:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1784186596.305414:0:5771:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1784186596.305469:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.305476:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784186596.305498:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.305505:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16a00/0x55bc3e8c99d19126 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d1912d expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.305517:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186596.305519:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186596.305521:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186596.305582:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937988480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784186596.305659:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186596.305766:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937988480 00000100:00100000:3.0:1784186596.305776:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937988480 00000100:00100000:3.0:1784186596.305839:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784186596.305849:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fe54b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3308:x1870854937988480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186596.305864:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186596.305880:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf16400/0x55bc3e8c99d1912d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d19126 expref: 19 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.305907:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186596.305950:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fe54b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+18:3308:x1870854937988480:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186596.305959:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784186596.306061:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937988480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784186596.306215:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870854937988352:0@lo:39:umount.0 00000100:00100000:0.0:1784186596.306251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186596.306323:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937988352 00000100:00100000:1.0:1784186596.306328:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937988352 00000100:00100000:1.0:1784186596.306365:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1784186596.306372:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870854937988352:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784186596.306392:0:5782:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18eb0 00000100:00080000:1.0:1784186596.306400:0:5782:0:(import.c:65:import_set_state_nolock()) ffff9b9ffd521800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784186596.306486:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1870854937988352:12345-0@lo:39:umount.0 Request processed in 114us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186596.306502:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1784186596.306526:0:5782:0:(genops.c:906:class_export_put()) final put ffff9b9ffd526800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784186596.306553:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffd526800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784186596.306595:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ffd521800 for lustre-MDT0000 00000100:00080000:1.0:1784186596.306621:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeeea000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784186596.306630:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870854937988352:0@lo:39:umount.0 00000100:00080000:2.0:1784186596.306759:0:12856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784186596.306763:0:12856:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784186596.306767:0:12856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784186596.307170:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186596.314986:0:12856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315008:0:12856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315026:0:12856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315033:0:12856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315067:0:12856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784186596.315074:0:12856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315080:0:12856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315086:0:12856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315109:0:12856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315128:0:12856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784186596.315136:0:12856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315142:0:12856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315148:0:12856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315153:0:12856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315168:0:12856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1784186596.315178:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784186596.315185:0:11501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315192:0:11501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17400 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:3.0:1784186596.315196:0:11501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315204:0:11501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784186596.315212:0:11501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186596.315226:0:11501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784186596.315228:0:11501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1784186596.315269:0:11501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315275:0:11501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784186596.315303:0:11501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315310:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf17400/0x55bc3e8c99d19134 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d1913b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315325:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784186596.315328:0:11501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315333:0:11501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed400 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:3.0:1784186596.315336:0:11501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315343:0:11501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784186596.315348:0:11501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186596.315353:0:11501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784186596.315355:0:11501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1784186596.315357:0:11501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1784186596.315379:0:11501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315384:0:11501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784186596.315400:0:11501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315407:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed400/0x55bc3e8c99d1905b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d19062 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315420:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186596.315423:0:11501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315428:0:11501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128a00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:3.0:1784186596.315431:0:11501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315438:0:11501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784186596.315479:0:11501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186596.315485:0:11501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784186596.315487:0:11501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784186596.315489:0:11501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784186596.315502:0:11501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315508:0:11501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784186596.315515:0:11501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315528:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128a00/0x55bc3e8c99d1934f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d19356 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315537:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186596.315539:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186596.315540:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186596.315562:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937988736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784186596.315630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186596.315684:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784186596.315690:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937988864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784186596.315713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186596.315743:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937988736 00000100:00100000:3.0:1784186596.315751:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937988736 00000100:00100000:3.0:1784186596.315796:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937988864 00000100:00100000:3.0:1784186596.315799:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937988864 00000100:00100000:3.0:1784186596.315820:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784186596.315828:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+19:3306:x1870854937988736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186596.315843:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186596.315860:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda505000/0x55bc3e8c99d19062 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d1905b expref: 19 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315877:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186596.315913:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+18:3306:x1870854937988736:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186596.315921:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784186596.315941:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784186596.315947:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+17:3306:x1870854937988864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186596.315962:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186596.315971:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9128c00/0x55bc3e8c99d19356 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d1934f expref: 17 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.315980:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186596.316003:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6759c-e30b-4013-88b9-0b4d132afa93+16:3306:x1870854937988864:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186596.316009:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784186596.316027:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784186596.316034:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937988608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784186596.316069:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186596.316108:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937988864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784186596.316116:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fab6759c-e30b-4013-88b9-0b4d132afa93:3306:1870854937988736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784186596.316142:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937988608 00000100:00100000:3.0:1784186596.316145:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937988608 00000100:00100000:3.0:1784186596.316163:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784186596.316168:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+16:3308:x1870854937988608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186596.316175:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186596.316183:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1913b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d19134 expref: 16 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.316192:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186596.316216:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+15:3308:x1870854937988608:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186596.316223:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784186596.316242:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937988608:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186596.316283:0:12856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fca860200/0x55bc3e8c99d18e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.316292:0:12856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fca860200/0x55bc3e8c99d18e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.316298:0:12856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fca860200/0x55bc3e8c99d18e0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.316304:0:12856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9fca860200/0x55bc3e8c99d18e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.316316:0:12856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784186596.316319:0:12856:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1784186596.316323:0:12856:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1784186596.316345:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186596.316349:0:11501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fca860200/0x55bc3e8c99d18e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.316356:0:11501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fca860200 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:3.0:1784186596.316359:0:11501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fca860200/0x55bc3e8c99d18e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.316366:0:11501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fca860200/0x55bc3e8c99d18e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784186596.316372:0:11501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fca860200/0x55bc3e8c99d18e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186596.316377:0:11501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1784186596.316384:0:11501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1784186596.316386:0:11501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1784186596.316401:0:11501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fca860200/0x55bc3e8c99d18e0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.316407:0:11501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784186596.316417:0:11501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fca860200/0x55bc3e8c99d18e0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.316424:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fca860200/0x55bc3e8c99d18e0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d18e16 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.316437:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186596.316467:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186596.316469:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186596.316477:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937988992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784186596.316498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186596.316523:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937988992 00000100:00100000:3.0:1784186596.316525:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937988992 00000100:00100000:3.0:1784186596.316544:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784186596.316549:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+15:3308:x1870854937988992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186596.316556:0:5767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186596.316563:0:5767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fca861000/0x55bc3e8c99d18e16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d18e0f expref: 15 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.316574:0:5767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186596.316594:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6759c-e30b-4013-88b9-0b4d132afa93+14:3308:x1870854937988992:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186596.316600:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784186596.316619:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fab6759c-e30b-4013-88b9-0b4d132afa93:3308:1870854937988992:0@lo:103:ldlm_bl.0 00000020:01000004:3.0:1784186596.316645:0:12856:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1784186596.316649:0:12856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1784186596.316654:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784186596.316660:0:12856:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1784186596.316665:0:12856:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b9ec5bd9000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784186596.316671:0:12856:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9b9ec48a2800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784186596.316676:0:12856:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9b9ffeefb380) has exports, disconnecting them 00000020:00080000:3.0:1784186596.316680:0:12856:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b9ec5bd9000), last request at 1784186594 00000020:00000080:3.0:1784186596.316686:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d19023 00000100:00080000:3.0:1784186596.316701:0:12856:0:(import.c:65:import_set_state_nolock()) ffff9b9ec5bdf800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784186596.316731:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784186596.316741:0:12856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b9ec5bd9000): rc 0 00000020:00000080:3.0:1784186596.316744:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ec5bd9000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1784186596.316753:0:12856:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9b9ec48a2800), last request at 1784186594 00000020:00000080:3.0:1784186596.316756:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18f58 00000100:00080000:3.0:1784186596.316760:0:12856:0:(import.c:65:import_set_state_nolock()) ffff9b9ec48a6800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784186596.316768:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784186596.316773:0:12856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b9ec48a2800): rc 0 00000020:00000080:3.0:1784186596.316775:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ec48a2800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1784186596.316785:0:12856:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffab9e80d87ae0 00000100:00080000:3.0:1784186596.316803:0:12856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784186596.316807:0:12856:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1784186596.316820:0:12856:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784186596.316888:0:12856:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784186596.316899:0:12856:0:(import.c:65:import_set_state_nolock()) ffff9b9fc364e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784186596.316909:0:12856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784186596.316911:0:12856:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1784186596.316919:0:12856:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1784186596.316993:0:12856:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784186596.317002:0:12856:0:(import.c:65:import_set_state_nolock()) ffff9b9fef86a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1784186596.317032:0:12856:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b9ffeefb380) has no exports 00010000:00010000:0.0:1784186596.317128:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186596.317641:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784186596.317667:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec5bd9000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1784186596.317703:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec48a2800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784186596.317726:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ec5bdf800 for lustre-MDT0000 00000020:00000080:1.0:1784186596.317733:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ec48a6800 for lustre-MDT0000 00000100:00100000:1.0:1784186596.317749:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937989120:0@lo:9:umount.0 00000100:00100000:1.0:1784186596.317797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186596.317832:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937989248:0@lo:9:umount.0 00000100:00100000:1.0:1784186596.317853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186596.317887:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937989120 00000100:00100000:1.0:1784186596.317892:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937989120 00000100:00100000:1.0:1784186596.317933:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937989248 00000100:00100000:1.0:1784186596.317936:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937989248 00000100:00100000:1.0:1784186596.317957:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784186596.317965:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870854937989120:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784186596.317986:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18fa5 00000100:00080000:1.0:1784186596.317994:0:6584:0:(import.c:65:import_set_state_nolock()) ffff9b9ec48a0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784186596.318050:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1784186596.318388:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1870854937989120:12345-0@lo:9:umount.0 Request processed in 422us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186596.318406:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784186596.318424:0:6584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784186596.318430:0:6584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1870854937989248:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784186596.318474:0:6584:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d1908c 00000100:00080000:1.0:1784186596.318481:0:6584:0:(import.c:65:import_set_state_nolock()) ffff9b9fef868800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784186596.318503:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1784186596.318688:0:6584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1870854937989248:12345-0@lo:9:umount.0 Request processed in 257us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186596.318695:0:6584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1784186596.318717:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186596.318721:0:5778:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784186596.318734:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784186596.318759:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fc364e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784186596.318770:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784186596.318772:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784186596.318775:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937989120:0@lo:9:umount.0 00000100:00080000:1.0:1784186596.318786:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fef86a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784186596.318793:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784186596.318795:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784186596.318797:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937989248:0@lo:9:umount.0 00010000:00010000:1.0:1784186596.318827:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784186596.334409:0:12856:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9b9ffeefb380) has no exports 00000020:00000080:2.0:1784186596.406648:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18e6a 00000020:00000080:2.0:1784186596.406666:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ffeecf800/lustre-QMT0000_UUID 00000020:01000000:2.0:1784186596.406680:0:12856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1784186596.406835:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffeecf800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1784186596.406863:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784186596.406873:0:12856:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784186596.406878:0:12856:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9b9fc7760000) has no exports 00000020:00000080:1.0:1784186596.407361:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18e63 00000020:00000080:1.0:1784186596.407368:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ffeb8a000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784186596.407434:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784186596.407481:0:12856:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784186596.407484:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ffd56b800/lustre-QMT0000_UUID 00000020:00000080:1.0:1784186596.407487:0:12856:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffd56b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1784186596.407492:0:12856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1784186596.407929:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffeb8a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784186596.408064:0:12856:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b9fd0e4c720 - data ffff9b9ffbc8f798/ffff9b9ec4a02c00 00000020:01000000:1.0:1784186596.408207:0:12856:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b9fd11c42a0 - data ffff9b9ff8773870/ffff9b9ffec77c00 00010000:00010000:2.0:1784186596.413655:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1784186596.423586:0:12856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1784186596.478362:0:12856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784186596.478384:0:12856:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1784186596.478409:0:12856:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784186596.478412:0:12856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784186596.484166:0:6766:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784186596.484177:0:6766:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1784186596.484194:0:6766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1784186596.485533:0:12856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784186596.485540:0:12856:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1784186596.485555:0:12856:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784186596.485558:0:12856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784186596.485920:0:7863:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784186596.485924:0:7863:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1784186596.485934:0:7863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1784186596.615902:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18e32 00000020:00000080:1.0:1784186596.615915:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ffeeec800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784186596.615995:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffeeec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784186596.619239:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18e47 00000020:00000080:1.0:1784186596.619253:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ffef02000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784186596.619272:0:12856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1784186596.619281:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784186596.619289:0:12856:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784186596.619293:0:12856:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9b9ffeef99c0) has no exports 00000020:00000080:0.0:1784186596.619515:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffef02000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1784186596.620133:0:12856:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784186596.620142:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d19085 00000020:00000080:1.0:1784186596.620148:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ec4893800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784186596.620161:0:12856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784186596.620166:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784186596.620173:0:12856:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784186596.620176:0:12856:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9b9fd1850000) has no exports 00000020:00000080:1.0:1784186596.620182:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d1907e 00000020:00000080:1.0:1784186596.620185:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9fef86c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784186596.620366:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec4893800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784186596.620382:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fef86c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784186596.620520:0:12856:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784186596.620524:0:12856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784186596.620528:0:12856:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1784186596.620533:0:12856:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784186596.620535:0:12856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784186596.620566:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9fef86a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784186596.620570:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784186596.620576:0:12856:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784186596.620579:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ffdf0d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784186596.620593:0:12856:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffdf0d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784186596.620598:0:12856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784186596.620661:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18f9e 00000020:00000080:1.0:1784186596.620665:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ec4895800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784186596.620679:0:12856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784186596.620682:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784186596.620686:0:12856:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784186596.620688:0:12856:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9b9fd18519c0) has no exports 00000020:00000080:1.0:1784186596.620692:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18f97 00000020:00000080:1.0:1784186596.620694:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9fd1877800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784186596.620780:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec4895800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784186596.620786:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fd1877800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784186596.620977:0:12856:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784186596.620980:0:12856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784186596.620982:0:12856:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1784186596.620986:0:12856:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784186596.620987:0:12856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784186596.621020:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784186596.621025:0:12856:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784186596.621056:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9fc364e000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784186596.621060:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784186596.621061:0:38:0:(genops.c:906:class_export_put()) final put ffff9b9ec4a84000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784186596.621063:0:12856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784186596.621063:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec4a84000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784186596.621066:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ffeee9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784186596.621068:0:12856:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffeee9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784186596.621068:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784186596.621075:0:12856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784186596.621187:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18e4e 00000020:00000080:1.0:1784186596.621192:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ffef04800/lustre-MDD0000_UUID 00000020:01000000:1.0:1784186596.621209:0:12856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1784186596.621212:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784186596.621216:0:12856:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784186596.621218:0:12856:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9b9ffeef8000) has no exports 00000020:00000080:1.0:1784186596.621236:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784186596.621238:0:12856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1784186596.621241:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18e55 00000020:00000080:1.0:1784186596.621249:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ffef00000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784186596.621256:0:12856:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b9fc5f8f800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1784186596.621258:0:12856:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9fc5f8f800 3 00000020:01000004:1.0:1784186596.621261:0:12856:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b9fc5f8f800 from lustre-MDT0000 00000020:00000080:1.0:1784186596.621278:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784186596.621282:0:12856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1784186596.621289:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ffeee8000/lustre-MDT0000_UUID 00000020:00000080:1.0:1784186596.621291:0:12856:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffeee8000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1784186596.621298:0:12856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1784186596.621324:0:12856:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1784186596.621328:0:12856:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1784186596.621330:0:12856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1784186596.621333:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784186596.621336:0:12856:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784186596.621342:0:12856:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9b9fd18cf800 fab6759c-e30b-4013-88b9-0b4d132afa93 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784186596.621346:0:12856:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9b9fc77619c0) has exports, disconnecting them 00000020:00080000:1.0:1784186596.621350:0:12856:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9b9fd18cf800), last request at 1784186372 00000020:00000080:1.0:1784186596.621362:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18dec 00000020:00010000:1.0:1784186596.621365:0:12856:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9b9fd18cf800: total 2 00000100:00080000:1.0:1784186596.621368:0:12856:0:(import.c:65:import_set_state_nolock()) ffff9b9fd18cf000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784186596.621385:0:12856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b9fd18cf800): rc 0 00000020:00080000:1.0:1784186596.621389:0:12856:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9b9fc77619c0) has no exports 00000020:00010000:3.0:1784186596.621580:0:5771:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9b9fd18cf800: total 2 00010000:00010000:3.0:1784186596.621610:0:5771:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9b9fd18cf800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1784186596.621637:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9129200/0x55bc3e8c99d19103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d190fc expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.621653:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27ec600/0x55bc3e8c99d19111 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d1910a expref: 8 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.621664:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9129600/0x55bc3e8c99d1933a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d19333 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.621675:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf17a00/0x55bc3e8c99d1911f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d19118 expref: 6 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.621687:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda504a00/0x55bc3e8c99d18f0b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d18f04 expref: 5 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.621700:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9129e00/0x55bc3e8c99d19149 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d19142 expref: 4 pid: 5775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.621724:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc9129400/0x55bc3e8c99d19348 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d19341 expref: 3 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.621737:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc27ed000/0x55bc3e8c99d190f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x55bc3e8c99d190ee expref: 2 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186596.621748:0:5771:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9b9fd18cf800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1784186596.621760:0:5771:0:(genops.c:906:class_export_put()) final put ffff9b9fd18cf800/fab6759c-e30b-4013-88b9-0b4d132afa93 00010000:00010000:3.0:1784186596.621776:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186596.621778:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186596.621780:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784186596.621946:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffef04800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784186596.621951:0:38:0:(genops.c:906:class_export_put()) final put ffff9b9ffef05000/lustre-MDD0000_UUID 00000020:00000080:0.0:1784186596.621953:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffef05000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1784186596.621957:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1784186596.622103:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffef00000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784186596.622113:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fd18cf800/fab6759c-e30b-4013-88b9-0b4d132afa93 for MGS 00000020:00000080:0.0:1784186596.622129:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9fd18cf000 for MGS 00000100:00100000:0.0:1784186596.622158:0:5777:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9b9fc7e3e200:5777] 2 exiting: rc = 0 00000100:00100000:0.0:1784186596.622310:0:5775:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9b9fc906fe00:5775] 1 exiting: rc = 0 00000100:00100000:0.0:1784186596.622360:0:5774:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9b9fc77d7a00:5774] 0 exiting: rc = 1 00000100:00100000:3.0:1784186596.627487:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627499:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627508:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627514:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627520:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627526:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627532:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627537:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627543:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627549:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627556:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627562:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627569:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627575:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627581:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627588:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627595:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627601:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627608:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627614:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627634:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627640:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627647:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627653:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627658:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627663:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627669:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627674:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627679:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627684:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627689:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627695:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627701:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627707:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627714:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627720:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627727:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627732:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627738:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627745:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627750:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627756:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627762:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627768:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627774:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627780:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627786:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627792:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627798:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627804:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627810:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627815:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627822:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627828:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627834:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627846:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627851:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627856:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627972:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627978:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627983:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627989:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.627996:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.628001:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1784186596.628518:0:12856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784186596.628522:0:12856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1784186596.629971:0:12856:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b9ffecd1f00 - data ffff9b9fdd3eebd0/ffff9b9fc9137400 00000020:01000000:3.0:1784186596.630118:0:12856:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b9fd13f33c0 - data ffff9b9ff86f8948/ffff9b9fc9097400 00000020:00000080:3.0:1784186596.630734:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18dd7 00000020:00000080:3.0:1784186596.630741:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9fc92cb000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784186596.630932:0:12856:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b9fc5f8f800 from MGS, refs=2 00000020:01000004:3.0:1784186596.630936:0:12856:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9fc5f8f800 2 00000020:01000004:3.0:1784186596.630940:0:12856:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b9fc5f8f800 from MGS 00000020:00000080:3.0:1784186596.630964:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784186596.630971:0:12856:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1784186596.630974:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9fc5f8f000/MGS 00000020:00000080:3.0:1784186596.630977:0:12856:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fc5f8f000/MGS for MGS 00000020:01000000:3.0:1784186596.630984:0:12856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1784186596.631051:0:12856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1784186596.631055:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784186596.631060:0:12856:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784186596.631067:0:12856:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9b9ffeee8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784186596.631072:0:12856:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9b9fc92e3380) has exports, disconnecting them 00000020:00080000:3.0:1784186596.631077:0:12856:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9b9ffeee8800), last request at 1784186373 00000020:00000080:3.0:1784186596.631081:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18ea2 00000020:00080000:3.0:1784186596.631091:0:12856:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b9ffeee8800): rc 0 00000020:00000080:3.0:1784186596.631095:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9ffeee8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784186596.631301:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fc92cb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784186596.632410:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffeee8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1784186596.641014:0:12856:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1784186596.641024:0:12856:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784186596.641028:0:12856:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784186596.641045:0:12856:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784186596.641240:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784186596.641248:0:12856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1784186596.641256:0:12856:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9fc5f8f800 1 00000020:00000080:2.0:1784186596.641262:0:12856:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18dc9 00000020:00000080:2.0:1784186596.641271:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9fc5f88000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784186596.641300:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ffeeea000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784186596.641308:0:8:0:(genops.c:906:class_export_put()) final put ffff9b9ffd520000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784186596.641310:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffd520000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784186596.641327:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1784186596.641736:0:12856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1784186596.641742:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784186596.641747:0:12856:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784186596.641751:0:12856:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9b9fc9270000) has no exports 00000020:00000080:1.0:1784186596.642969:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fc5f88000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784186596.697131:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784186596.697159:0:12856:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784186596.697164:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9fc92cc000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784186596.697174:0:12856:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fc92cc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784186596.697186:0:12856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784186596.697303:0:12856:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b9fc5f8d000 00000020:01000000:1.0:1784186596.697323:0:12856:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1784186596.697327:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784186596.697331:0:12856:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784186596.697335:0:12856:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9b9fc9274d40) has no exports 00000100:00100000:1.0:1784186596.697406:0:5782:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9b9fc2f91c00:5782] 0 exiting: rc = 1 00000100:00100000:0.0:1784186596.698237:0:5784:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9b9fc2f91e00:5784] 2 exiting: rc = 0 00000100:00100000:2.0:1784186596.699630:0:5783:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9b9fd0097e00:5783] 1 exiting: rc = 0 00000100:00100000:2.0:1784186596.699717:0:7478:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9b9ec4838200:7478] 3 exiting: rc = 0 00000100:00100000:1.0:1784186596.703227:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703237:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703243:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703248:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703253:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703261:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703266:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703272:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703277:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703282:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703287:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703291:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703296:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703301:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703307:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703867:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703877:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703882:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703887:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703893:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703898:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703903:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703908:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703914:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703932:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703936:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703940:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703944:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703947:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703951:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703955:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703958:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703961:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703964:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703968:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703972:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703975:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703979:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703983:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703986:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703990:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703993:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.703997:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704000:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704002:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704005:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704009:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704012:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704015:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704018:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704020:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704024:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704027:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704042:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704048:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704054:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704950:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704955:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704960:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704972:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704977:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.704983:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.705249:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.705255:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.714774:0:5786:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9b9fc2f79a00:5786] 1 exiting: rc = 0 00000100:00100000:3.0:1784186596.715231:0:5785:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9b9fd0097600:5785] 0 exiting: rc = 1 00000100:00100000:1.0:1784186596.715431:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715700:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715708:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715712:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715716:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715720:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715725:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715729:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715732:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715736:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715741:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715746:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715751:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715754:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715758:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715761:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715764:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715767:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715771:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715775:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715778:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715781:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715784:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715972:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715976:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715979:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715982:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715985:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.715989:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716002:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716006:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716010:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716013:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716016:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716020:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716023:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716026:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716029:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716044:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716049:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716054:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716065:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716071:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716076:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716082:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716087:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716092:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716097:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716103:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716108:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716112:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716117:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716122:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716127:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716131:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716137:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716142:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716147:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716152:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716156:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716160:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716164:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716180:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.716187:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.719183:0:5788:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9b9fc2f92000:5788] 1 exiting: rc = 0 00000100:00100000:1.0:1784186596.719893:0:5787:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9b9fc2f92800:5787] 0 exiting: rc = 1 00000100:00100000:0.0:1784186596.720098:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720197:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720207:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720213:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720236:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720249:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720254:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720261:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720272:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720282:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720288:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720297:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720303:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720317:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720367:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720389:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720432:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720507:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720516:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720525:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720533:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720540:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720549:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720556:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720564:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720572:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720580:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720601:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720628:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720636:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720641:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720647:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720653:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720659:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720665:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720671:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720677:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720683:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720689:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720695:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720714:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720720:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720727:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720733:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720739:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720744:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720750:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720756:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720762:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720768:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720774:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720780:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720798:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720804:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720811:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720817:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720822:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720828:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720835:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.720841:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.721177:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.721184:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.721199:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.721208:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.745402:0:5789:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9b9fc9c67400:5789] 0 exiting: rc = 1 00000100:00100000:3.0:1784186596.745912:0:5790:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9b9fc9c5d400:5790] 1 exiting: rc = 0 00000100:00100000:1.0:1784186596.747015:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747022:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747028:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747044:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747049:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747054:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747059:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747064:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747070:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747075:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747079:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747085:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747090:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747095:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747100:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747106:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747282:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747287:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747292:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747297:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747302:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747307:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747386:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747392:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747397:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747401:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747406:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747411:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747416:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747421:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747426:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747430:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747435:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747465:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747484:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747490:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747495:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747500:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747506:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747511:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747516:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747522:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747527:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747532:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747537:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747542:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747547:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747552:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747557:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747562:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747568:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747572:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747577:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747582:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747587:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747592:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747597:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747602:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747607:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747612:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747617:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747622:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747638:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.747643:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.748531:0:5791:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9b9fc9c5c200:5791] 0 exiting: rc = 1 00000100:00100000:0.0:1784186596.748960:0:5792:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9b9fc9c5de00:5792] 1 exiting: rc = 0 00000100:00100000:1.0:1784186596.749080:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749087:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749092:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749097:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749286:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749292:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749298:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749303:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749377:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749387:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749393:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749398:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749402:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749407:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749412:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749417:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749422:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749427:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749432:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749437:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749502:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749509:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749513:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749518:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749523:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749527:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749531:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749535:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749540:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749544:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749548:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749552:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749557:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749561:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749565:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749570:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749574:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749579:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749584:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749598:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749603:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749608:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749613:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749618:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749683:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749692:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749698:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749703:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749708:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749713:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749718:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749723:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749728:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749734:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749739:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749744:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749749:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749754:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749759:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749764:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749769:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749774:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749780:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784186596.749785:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.751165:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9b9fc9c5d000:5793] 0 exiting: rc = 1 00000100:00100000:1.0:1784186596.752268:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9b9fc9c5ca00:5794] 1 exiting: rc = 0 00000100:00100000:0.0:1784186596.752960:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.752969:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.752974:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.752980:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.752985:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.752989:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.752994:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.752999:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753004:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753010:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753015:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753020:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753026:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753042:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753048:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753053:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753058:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753062:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753067:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753072:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753077:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753082:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753087:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753092:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753098:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753103:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753116:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753122:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753127:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753132:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753137:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753154:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753158:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753164:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753178:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753184:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753189:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753194:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753199:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753204:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753209:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753214:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753219:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753224:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753228:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753233:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753238:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753243:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753248:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753253:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753258:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753263:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753268:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753273:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753278:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753283:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753288:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753294:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753299:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753304:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753463:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753472:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753477:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.753483:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186596.754403:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9b9fc89e2400:5795] 0 exiting: rc = 1 00000100:00100000:0.0:1784186596.754578:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9b9fc89e3600:5797] 2 exiting: rc = 0 00000100:00100000:1.0:1784186596.754978:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9b9fc9c35400:5796] 1 exiting: rc = 0 00000100:00100000:0.0:1784186596.755498:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755519:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755525:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755530:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755536:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755542:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755550:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755555:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755560:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755568:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755575:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755582:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755587:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755593:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755598:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755602:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755607:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755613:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755619:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755745:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755752:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755758:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755778:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755785:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755856:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755862:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755869:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755875:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755882:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755887:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755891:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755897:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755902:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755908:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755914:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755919:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755934:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755939:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755944:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755950:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755955:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755961:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755967:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755972:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755978:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.755983:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756002:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756008:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756013:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756019:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756025:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756041:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756048:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756053:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756059:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756065:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756070:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756075:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756080:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756086:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756092:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756097:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756102:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186596.756236:0:12856:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784186596.764938:0:12856:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784186596.764954:0:12856:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1784186596.764960:0:12856:0:(genops.c:906:class_export_put()) final put ffff9b9fd18c8000/MDS_uuid 00000020:00000080:1.0:1784186596.764965:0:12856:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fd18c8000/MDS_uuid for MDS 00000020:01000000:1.0:1784186596.764970:0:12856:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1784186596.765114:0:12856:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1784186597.437619:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784186598.109893:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784186598.109903:0:6607:0:(genops.c:906:class_export_put()) final put ffff9b9ec48a7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784186598.109975:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec48a7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1784186598.110050:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ec48a0000 for lustre-OST0000 00010000:00010000:2.0:1784186598.463028:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186599.486688:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784186599.597721:0:13009:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784186599.618960:0:13009:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1784186599.619187:0:13009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186599.619203:0:13009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186599.619210:0:13009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186599.619218:0:13009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186599.619466:0:13009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784186599.619472:0:13009:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784186599.619494:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784186599.619498:0:13009:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784186599.619503:0:13009:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784186599.619528:0:13009:0:(import.c:65:import_set_state_nolock()) ffff9b9ec4a85000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1784186599.622614:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186599.622625:0:11501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186599.622637:0:11501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16800 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:1.0:1784186599.622641:0:11501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186599.622650:0:11501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784186599.622657:0:11501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186599.622663:0:11501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784186599.622665:0:11501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784186599.622669:0:11501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784186599.622694:0:11501:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186599.622700:0:11501:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784186599.622707:0:11501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186599.622715:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1910a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x55bc3e8c99d19111 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186599.622727:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186599.622729:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186599.622731:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186599.622763:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1870854937989376:0@lo:39:umount.0 00000400:00000100:1.0:1784186599.622813:0:3305:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870854937989376 offset 0 length 224: 4 00000100:00100000:1.0:1784186599.622871:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937989504:0@lo:400:kworker.0 00000400:00000100:1.0:1784186599.622893:0:3309:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854937989504 offset 0 length 224: 4 00000100:00100000:1.0:1784186599.622918:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937989760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784186599.622945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186599.622959:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784186599.622964:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854937989632:0@lo:400:kworker.0 00000400:00000100:1.0:1784186599.622979:0:3307:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870854937989632 offset 0 length 224: 4 00000100:00100000:3.0:1784186599.624261:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937989760 00000100:00100000:3.0:1784186599.624273:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937989760 00000100:00100000:3.0:1784186599.626203:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784186599.626212:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3307:x1870854937989760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1784186599.626220:0:5767:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784186599 with bad export cookie 6177881562442468844 00000100:00100000:3.0:1784186599.635087:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3307:x1870854937989760:12345-0@lo:103:ldlm_bl.0 Request processed in 8865us (12131us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784186599.635101:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1784186599.635108:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.131@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784186599.635113:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b9fd4f67800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1784186599.635117:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1784186599.643619:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.131@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1784186599.643625:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784186599.643634:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b9ffe061180 x1870854937989504/t0(0) o400->MGC192.168.201.131@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784186615 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186599.643658:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b9ffe062300 x1870854937989760/t0(0) o103->MGC192.168.201.131@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784186615 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784186599.643669:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784186599.643672:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784186599.643673:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1784186599.643678:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9b9fd4f67800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784186599.643683:0:3307:0:(import.c:510:import_select_connection()) MGC192.168.201.131@tcp: connect to NID 0@lo last attempt 150 00000100:00080000:2.0:1784186599.643691:0:3307:0:(import.c:624:import_select_connection()) MGC192.168.201.131@tcp: import ffff9b9fd4f67800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1784186599.644037:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fab6759c-e30b-4013-88b9-0b4d132afa93:3309:1870854937989504:0@lo:400:kworker.0 00000100:00100000:2.0:1784186599.645544:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffeeb3480 x1870854937989888/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784186599.645595:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fab6759c-e30b-4013-88b9-0b4d132afa93:3305:1870854937989888:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1784186599.645644:0:3305:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854937989888 offset 0 length 520: 4 00000100:00100000:2.0:1784186599.645692:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fab6759c-e30b-4013-88b9-0b4d132afa93:3307:1870854937989760:0@lo:103:ldlm_bl.0 00000001:00100000:2.0:1784186599.661779:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784186599.661787:0:7480:0:(genops.c:906:class_export_put()) final put ffff9b9fef86e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784186599.661887:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fef86e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1784186599.661975:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9fef868800 for lustre-OST0001 00010000:00010000:2.0:1784186600.512677:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186601.533730:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186602.557829:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186603.581956:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186604.606849:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784186604.733624:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) fab6759c-e30b-4013-88b9-0b4d132afa93->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784186604.733635:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) fab6759c-e30b-4013-88b9-0b4d132afa93->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784186604.733761:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937990016:0@lo:400:kworker.0 00000400:00000100:2.0:1784186604.733829:0:3308:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870854937990016 offset 0 length 224: 4 00010000:00010000:1.0:1784186605.631139:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186606.664647:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186607.679633:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186608.702436:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186609.725624:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784186609.853797:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) fab6759c-e30b-4013-88b9-0b4d132afa93->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784186609.853805:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) fab6759c-e30b-4013-88b9-0b4d132afa93->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784186609.853923:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784186609.853950:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937990144:0@lo:400:kworker.0 00000400:00000100:1.0:1784186609.854001:0:3308:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870854937990144 offset 0 length 224: 4 00000100:00100000:2.0:1784186609.854168:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784186599/real 1784186599] req@ffff9b9ffeeb3480 x1870854937989888/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784186609 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186609.854188:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b9ffeeb3480 x1870854937989888/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784186609 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186609.854198:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784186599/real 1784186599] req@ffff9b9ffeeb2d80 x1870854937989376/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784186609 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186609.854209:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b9ffeeb2d80 x1870854937989376/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784186609 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784186609.854221:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fd4f67800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784186609.854238:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1784186609.854242:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fab6759c-e30b-4013-88b9-0b4d132afa93:3305:1870854937989888:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1784186609.854256:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9ec4a85000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784186609.854267:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1870854937989376:0@lo:39:umount.0 00000100:00080000:2.0:1784186609.854291:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784186609.854295:0:13009:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784186609.854299:0:13009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784186609.855238:0:13009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186609.855252:0:13009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186609.855277:0:13009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186609.855284:0:13009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186609.855299:0:13009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784186609.855306:0:13009:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186609.855312:0:13009:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186609.855318:0:13009:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186609.855325:0:13009:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186609.855340:0:13009:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1784186609.855344:0:13009:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1784186609.855364:0:13009:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1784186609.855368:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1784186609.855372:0:13009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784186609.855376:0:13009:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784186609.855380:0:13009:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9b9fc92e4d40) has no exports 00000020:00080000:2.0:1784186609.855402:0:13009:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9b9fc92e4d40) has no exports 00010000:00010000:3.0:1784186609.856056:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784186609.856066:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186609.856075:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d000 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:3.0:1784186609.856079:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186609.856088:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784186609.856106:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186609.856112:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784186609.856115:0:5771:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1784186609.856117:0:5771:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1784186609.856133:0:5771:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b9fd4f67800 00010000:00010000:3.0:1784186609.856136:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186609.856143:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d000/0x55bc3e8c99d19118 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d1911f expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186609.856157:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186609.856160:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186609.856165:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128200 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:3.0:1784186609.856168:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186609.856175:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784186609.856181:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186609.856185:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784186609.856188:0:5771:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784186609.856193:0:5771:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784186609.856199:0:5771:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b9fd4f67800 00010000:00010000:3.0:1784186609.856202:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186609.856208:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128200/0x55bc3e8c99d19341 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d19348 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186609.856216:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186609.856217:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186609.856219:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186609.856241:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784186609.856865:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) fab6759c-e30b-4013-88b9-0b4d132afa93->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784186609.856872:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1784186609.856876:0:38:0:(import.c:65:import_set_state_nolock()) ffff9b9fd4f67800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784186609.856883:0:38:0:(import.c:510:import_select_connection()) MGC192.168.201.131@tcp: connect to NID 0@lo last attempt 378 00000100:00080000:1.0:1784186609.856888:0:38:0:(import.c:589:import_select_connection()) MGC192.168.201.131@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784186609.856894:0:38:0:(import.c:624:import_select_connection()) MGC192.168.201.131@tcp: import ffff9b9fd4f67800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1784186609.856936:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffe061f80 x1870854937990272/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784186609.857084:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fab6759c-e30b-4013-88b9-0b4d132afa93:3305:1870854937990272:0@lo:250:kworker.0 00000400:00000100:3.0:1784186609.857134:0:3305:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870854937990272 offset 0 length 520: 4 00000020:01000000:2.0:1784186609.867392:0:13009:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b9ec58d5000 - data ffff9b9ff87615e8/ffff9b9ffe89bc00 00000020:01000000:2.0:1784186609.867593:0:13009:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b9ffe1c2d80 - data ffff9b9ec45b61b0/ffff9b9ec4a92800 00100000:10000000:2.0:1784186609.878091:0:13009:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1784186609.925789:0:13009:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18f27 00000020:00000080:3.0:1784186609.925802:0:13009:0:(genops.c:906:class_export_put()) final put ffff9b9ec48a3800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1784186609.925826:0:13009:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b9ffef01800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1784186609.925830:0:13009:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9ffef01800 2 00000020:01000004:3.0:1784186609.925834:0:13009:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b9ffef01800 from lustre-OST0000 00000020:00000080:3.0:1784186609.925858:0:13009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784186609.925868:0:13009:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1784186609.925871:0:13009:0:(genops.c:906:class_export_put()) final put ffff9b9ec48a4800/lustre-OST0000_UUID 00000020:00000080:3.0:1784186609.925874:0:13009:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec48a4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1784186609.925885:0:13009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1784186609.925936:0:13009:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1784186609.925942:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1784186609.925946:0:13009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784186609.925951:0:13009:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784186609.925958:0:13009:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9b9fd1872800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784186609.925964:0:13009:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9b9fc7764d40) has exports, disconnecting them 00000020:00080000:3.0:1784186609.925980:0:13009:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9b9fd1872800), last request at 1784186389 00000020:00000080:3.0:1784186609.925985:0:13009:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18f51 00000020:00080000:3.0:1784186609.925994:0:13009:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b9fd1872800): rc 0 00000020:00000080:3.0:1784186609.926000:0:13009:0:(genops.c:906:class_export_put()) final put ffff9b9fd1872800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1784186609.926730:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec48a3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784186609.926742:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fd1872800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1784186609.927030:0:13009:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1784186609.927036:0:13009:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784186609.927040:0:13009:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784186609.927045:0:13009:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784186609.927153:0:13009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784186609.927160:0:13009:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1784186609.927166:0:13009:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9ffef01800 1 00000020:00000080:2.0:1784186609.927170:0:13009:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18ee1 00000020:00000080:2.0:1784186609.927178:0:13009:0:(genops.c:906:class_export_put()) final put ffff9b9fd18ca000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1784186609.927182:0:13009:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1784186609.927187:0:13009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784186609.927190:0:13009:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784186609.927194:0:13009:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9b9ffeefcd40) has no exports 00000020:00000080:1.0:1784186609.933414:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ec4a85000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1784186609.933433:0:38:0:(genops.c:906:class_export_put()) final put ffff9b9ec4a85800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1784186609.933437:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec4a85800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1784186609.933477:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1784186609.933541:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fd18ca000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784186609.970476:0:13009:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784186609.970492:0:13009:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1784186609.970497:0:13009:0:(genops.c:906:class_export_put()) final put ffff9b9fe528e800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1784186609.970502:0:13009:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fe528e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1784186609.970513:0:13009:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1784186609.970665:0:13009:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b9fe528d800 00000020:02000400:1.0:1784186609.970718:0:13009:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1784186610.752213:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186611.774826:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186612.809893:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784186612.930261:0:13162:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784186612.947889:0:13162:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1784186612.947975:0:13162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186612.947991:0:13162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186612.947999:0:13162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186612.948006:0:13162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186612.949132:0:13162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784186612.949143:0:13162:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784186612.949181:0:13162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784186612.949194:0:13162:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b9ffe063b80 x1870854937989632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186615 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186612.949223:0:13162:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b9ffeeb4700 x1870854937990016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186620 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186612.949243:0:13162:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b9ffe060700 x1870854937990144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186625 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186612.949262:0:13162:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784186612.949267:0:13162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784186612.949295:0:13162:0:(import.c:65:import_set_state_nolock()) ffff9b9ec6813800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784186612.949360:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937990144:0@lo:400:kworker.0 00000100:00100000:1.0:1784186612.949368:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854937990016:0@lo:400:kworker.0 00000100:00100000:3.0:1784186612.949498:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1870854937990400:0@lo:39:umount.0 00000400:00000100:3.0:1784186612.949551:0:3305:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870854937990400 offset 0 length 224: 4 00000100:00100000:0.0:1784186612.952237:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854937989632:0@lo:400:kworker.0 00010000:00010000:2.0:1784186612.952670:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186612.952680:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186612.952692:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc9128000 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:2.0:1784186612.952696:0:5770:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186612.952707:0:5770:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186612.952810:0:5770:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186612.952816:0:5770:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784186612.952819:0:5770:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784186612.952836:0:5770:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784186612.952854:0:5770:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b9fd4f67800 00010000:00010000:2.0:1784186612.952858:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186612.952865:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc9128000/0x55bc3e8c99d190ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d190f5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186612.952966:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186612.952969:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186612.952971:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186613.821931:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186614.845694:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784186614.974789:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) fab6759c-e30b-4013-88b9-0b4d132afa93->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784186614.974800:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) fab6759c-e30b-4013-88b9-0b4d132afa93->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1784186615.869988:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186616.893929:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186617.919068:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186618.942938:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186619.966190:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784186620.093765:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) fab6759c-e30b-4013-88b9-0b4d132afa93->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784186620.093779:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) fab6759c-e30b-4013-88b9-0b4d132afa93->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1784186620.990048:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186622.014240:0:5770:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186622.141581:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784186612/real 1784186612] req@ffff9b9ffe063100 x1870854937990400/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784186622 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186622.141622:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b9ffe063100 x1870854937990400/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1784186622 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784186622.141640:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9ec6813800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784186622.141667:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1870854937990400:0@lo:39:umount.0 00000100:00080000:1.0:1784186622.141849:0:13162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784186622.141854:0:13162:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784186622.141859:0:13162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784186622.142819:0:13162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186622.142836:0:13162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186622.142844:0:13162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186622.142851:0:13162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186622.142881:0:13162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784186622.142889:0:13162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186622.142896:0:13162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186622.142901:0:13162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186622.142907:0:13162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186622.143047:0:13162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1784186622.143052:0:13162:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1784186622.143077:0:13162:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1784186622.143081:0:13162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1784186622.143086:0:13162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784186622.143091:0:13162:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784186622.143095:0:13162:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9b9fd1853380) has no exports 00000020:00080000:1.0:1784186622.143119:0:13162:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9b9fd1853380) has no exports 00000020:01000000:1.0:1784186622.150273:0:13162:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b9ec58d5ba0 - data ffff9b9ff876e870/ffff9b9ec53b8400 00000020:01000000:1.0:1784186622.150398:0:13162:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9b9ffe222a20 - data ffff9b9ff8717a20/ffff9b9ec53bbc00 00010000:00010000:2.0:1784186622.158962:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784186622.158977:0:11501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186622.158990:0:11501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16600 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:2.0:1784186622.158994:0:11501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186622.159005:0:11501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186622.159013:0:11501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186622.159019:0:11501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784186622.159021:0:11501:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1784186622.159024:0:11501:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1784186622.159041:0:11501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b9fd4f67800 00010000:00010000:2.0:1784186622.159045:0:11501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186622.159052:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16600/0x55bc3e8c99d190fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d19103 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186622.159078:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186622.159082:0:11501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186622.159087:0:11501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed200 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:2.0:1784186622.159090:0:11501:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186622.159097:0:11501:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186622.159104:0:11501:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186622.159109:0:11501:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784186622.159111:0:11501:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784186622.159113:0:11501:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784186622.159118:0:11501:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b9fd4f67800 00010000:00010000:2.0:1784186622.159121:0:11501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186622.159127:0:11501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed200/0x55bc3e8c99d19333 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d1933a expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186622.159138:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186622.159139:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186622.159141:0:11501:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186622.159258:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1784186622.167410:0:13162:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784186622.205176:0:13162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18ff2 00000020:00000080:2.0:1784186622.205187:0:13162:0:(genops.c:906:class_export_put()) final put ffff9b9ec5bd8800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1784186622.205220:0:13162:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b9fc9c79000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1784186622.205224:0:13162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9fc9c79000 2 00000020:01000004:2.0:1784186622.205228:0:13162:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9b9fc9c79000 from lustre-OST0001 00000020:00000080:2.0:1784186622.205249:0:13162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784186622.205260:0:13162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1784186622.205263:0:13162:0:(genops.c:906:class_export_put()) final put ffff9b9ffdf0e000/lustre-OST0001_UUID 00000020:00000080:2.0:1784186622.205265:0:13162:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ffdf0e000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1784186622.205272:0:13162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1784186622.205397:0:13162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import fab6759c-e30b-4013-88b9-0b4d132afa93->MGS 00010000:00010000:2.0:1784186622.205411:0:13162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fca861400/0x55bc3e8c99d18f04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d18f0b expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186622.205423:0:13162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fca861400/0x55bc3e8c99d18f04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d18f0b expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186622.205429:0:13162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1784186622.205432:0:13162:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1784186622.205435:0:13162:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1784186622.205482:0:13162:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b9fd4f67800 00010000:00010000:2.0:1784186622.205486:0:13162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fca861400/0x55bc3e8c99d18f04 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d18f0b expref: -99 pid: 6579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186622.205513:0:13162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16c00/0x55bc3e8c99d19142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x55bc3e8c99d19149 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186622.205521:0:13162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16c00/0x55bc3e8c99d19142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x55bc3e8c99d19149 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186622.205526:0:13162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784186622.205528:0:13162:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1784186622.205530:0:13162:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1784186622.205539:0:13162:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9b9fd4f67800 00010000:00010000:2.0:1784186622.205548:0:13162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16c00/0x55bc3e8c99d19142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x55bc3e8c99d19149 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784186622.205568:0:13162:0:(import.c:65:import_set_state_nolock()) ffff9b9fd4f67800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1784186622.205572:0:13162:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784186622.205575:0:13162:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784186622.205576:0:13162:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1784186622.205580:0:13162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784186622.205590:0:13162:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9b9ffe061f80 x1870854937990272/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784186624 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784186622.205616:0:13162:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784186622.205619:0:13162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:3.0:1784186622.205759:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec5bd8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1784186622.211059:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fab6759c-e30b-4013-88b9-0b4d132afa93:3305:1870854937990272:0@lo:250:kworker.0 10000000:01000000:2.0:1784186622.211647:0:13162:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1784186622.211673:0:13162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18de5 00000020:00000080:2.0:1784186622.211686:0:13162:0:(genops.c:906:class_export_put()) final put ffff9b9fd4f67000/fab6759c-e30b-4013-88b9-0b4d132afa93 00000020:01000000:2.0:1784186622.211710:0:13162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.131@tcp (flags='') 00000020:00000080:2.0:1784186622.211727:0:13162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784186622.211738:0:13162:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.131@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784186622.211742:0:13162:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9b9fc7763380) has no exports 10000000:01000000:0.0:1784186622.211797:0:5780:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1784186622.211856:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fd4f67000/fab6759c-e30b-4013-88b9-0b4d132afa93 for MGC192.168.201.131@tcp 10000000:01000000:2.0:1784186622.211929:0:13162:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.131@tcp: client import never connected 00000100:00080000:2.0:1784186622.211934:0:13162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1784186622.211937:0:13162:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784186622.211940:0:13162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1784186622.211942:0:13162:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1784186622.211991:0:13162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784186622.211997:0:13162:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.131@tcp (uuid fab6759c-e30b-4013-88b9-0b4d132afa93) 00000020:01000000:2.0:1784186622.212003:0:13162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1784186622.212007:0:13162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784186622.212010:0:13162:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784186622.212016:0:13162:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9b9ec6812800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784186622.212022:0:13162:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9b9ec6818000) has exports, disconnecting them 00000020:00080000:2.0:1784186622.212026:0:13162:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9b9ec6812800), last request at 1784186406 00000020:00000080:2.0:1784186622.212039:0:13162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d1901c 00000020:00000080:3.0:1784186622.212045:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9fd4f67800 for MGC192.168.201.131@tcp 00000020:00080000:2.0:1784186622.212050:0:13162:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9b9ec6812800): rc 0 00000020:00000080:3.0:1784186622.212051:0:37:0:(genops.c:906:class_export_put()) final put ffff9b9fc5f8e800/fab6759c-e30b-4013-88b9-0b4d132afa93 00000020:00000080:3.0:1784186622.212053:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fc5f8e800/fab6759c-e30b-4013-88b9-0b4d132afa93 for MGC192.168.201.131@tcp 00000020:00000080:2.0:1784186622.212053:0:13162:0:(genops.c:906:class_export_put()) final put ffff9b9ec6812800/lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1784186622.212061:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.131@tcp (fab6759c-e30b-4013-88b9-0b4d132afa93) 00000020:00000080:3.0:1784186622.212308:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec6812800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1784186622.217969:0:13162:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1784186622.217978:0:13162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784186622.217983:0:13162:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784186622.217989:0:13162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784186622.218759:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9b9ec6813800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1784186622.219678:0:5770:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1784186622.221739:0:11501:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1784186622.222465:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1784186622.222541:0:5765:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9b9fc8eda000:5765] 0 exiting: rc = 1 00000100:00100000:3.0:1784186622.223639:0:5766:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9b9fc4ba9400:5766] 1 exiting: rc = 0 00000100:00100000:2.0:1784186622.223949:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.224573:0:11003:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9b9ffe811a00:11003] 3 exiting: rc = 0 00000100:00100000:0.0:1784186622.224679:0:5768:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9b9fd1d20a00:5768] 1 exiting: rc = 0 00000100:00100000:1.0:1784186622.225927:0:5769:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9b9fd1d20400:5769] 2 exiting: rc = 0 00000100:00100000:2.0:1784186622.226912:0:5767:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9b9fd1d21000:5767] 0 exiting: rc = 1 00000100:00100000:0.0:1784186622.227042:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227051:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227058:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227064:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227069:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227074:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227080:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227085:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227091:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227097:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227102:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227109:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227115:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227121:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227127:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227133:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227140:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227146:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227150:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227156:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227162:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227167:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227172:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227177:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227182:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227187:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227191:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227210:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227216:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227221:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227226:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227233:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227238:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227244:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227248:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227253:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227257:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227262:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227267:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227273:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227278:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227283:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227288:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227293:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227298:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227303:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227308:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227314:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227319:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227324:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227329:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227334:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227339:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227344:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227350:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227355:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227360:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227365:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227370:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227375:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227381:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227386:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227400:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.227405:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784186622.230902:0:13162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784186622.230914:0:13162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1784186622.230920:0:13162:0:(genops.c:906:class_export_put()) final put ffff9b9ec6817800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1784186622.230926:0:13162:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9ec6817800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1784186622.230932:0:13162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1784186622.230977:0:13162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9fc9c79000 1 00000020:00000080:0.0:1784186622.230984:0:13162:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x55bc3e8c99d18fc1 00000020:00000080:0.0:1784186622.230991:0:13162:0:(genops.c:906:class_export_put()) final put ffff9b9fc777b800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1784186622.231008:0:13162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1784186622.231021:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fc777b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1784186622.231034:0:13162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784186622.231038:0:13162:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784186622.231042:0:13162:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9b9fc92e19c0) has no exports 00000020:00000080:0.0:1784186622.253797:0:13162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784186622.253815:0:13162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1784186622.253822:0:13162:0:(genops.c:906:class_export_put()) final put ffff9b9fc2e99800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1784186622.253828:0:13162:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fc2e99800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1784186622.253840:0:13162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1784186622.254057:0:13162:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9b9fc2e9b000 00000020:01000000:0.0:1784186622.254080:0:13162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1784186622.254085:0:13162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784186622.254089:0:13162:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784186622.254093:0:13162:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9b9fc92e0000) has no exports 00000020:00000080:0.0:1784186622.254126:0:13162:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784186622.254133:0:13162:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1784186622.254136:0:13162:0:(genops.c:906:class_export_put()) final put ffff9b9fd18ce800/OSS_uuid 00000020:00000080:0.0:1784186622.254139:0:13162:0:(genops.c:865:class_export_destroy()) destroying export ffff9b9fd18ce800/OSS_uuid for OSS 00000020:01000000:0.0:1784186622.254142:0:13162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1784186622.254214:0:12361:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9b9fef880e00:12361] 4 exiting: rc = 0 00000100:00100000:2.0:1784186622.257260:0:11903:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9b9fd11f3400:11903] 3 exiting: rc = 0 00000100:00080000:1.0:1784186622.257740:0:5778:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1784186622.257833:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9b9ffe468400:6584] 2 exiting: rc = 0 00000100:00100000:1.0:1784186622.257888:0:6583:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9b9ffe469a00:6583] 1 exiting: rc = 0 00000100:00100000:1.0:1784186622.257932:0:6581:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9b9fc2f92a00:6581] 0 exiting: rc = 1 00000100:00100000:0.0:1784186622.258643:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258663:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258669:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258676:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258680:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258741:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258747:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258752:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258757:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258762:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258767:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258772:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258778:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258783:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258789:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258795:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258800:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258806:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258811:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258817:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258822:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258827:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258832:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258836:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258841:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258847:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258851:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258856:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258861:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258866:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258872:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258877:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258881:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258886:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258891:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258896:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258908:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258912:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258917:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258922:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.258927:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259007:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259015:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259020:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259024:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259029:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259034:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259038:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259044:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259049:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259054:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259059:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259063:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259068:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259072:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259077:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259081:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259086:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259092:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259098:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259102:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259108:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259113:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.259118:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.260415:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9b9fd11e5000:6586] 1 exiting: rc = 0 00000100:00100000:1.0:1784186622.260729:0:11527:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9b9fc5fa7000:11527] 2 exiting: rc = 0 00000100:00100000:3.0:1784186622.261065:0:6585:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9b9fd11e4600:6585] 0 exiting: rc = 1 00000100:00100000:0.0:1784186622.261238:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261248:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261253:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261258:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261263:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261268:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261273:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261284:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261288:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261292:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261297:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261302:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261306:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261311:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261315:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261320:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261325:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261330:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261335:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261339:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261345:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261350:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261356:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261361:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261365:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261370:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261375:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261597:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261602:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261617:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261623:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261628:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261632:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261637:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261641:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261646:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261651:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261657:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261662:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261666:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261671:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261676:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261755:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261760:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261765:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261771:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261776:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261781:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261786:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261790:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261795:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261800:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261804:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261809:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261814:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261820:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261825:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261830:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261835:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261840:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261844:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261849:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261854:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.261860:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.263919:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9b9fc2f78200:6587] 0 exiting: rc = 1 00000100:00100000:3.0:1784186622.264998:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9b9ffe8f6000:6589] 2 exiting: rc = 0 00000100:00100000:0.0:1784186622.266093:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9b9fc2f78400:6588] 1 exiting: rc = 0 00000100:00100000:2.0:1784186622.266376:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266384:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266389:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266394:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266400:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266406:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266411:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266418:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266424:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266429:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266436:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266471:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266479:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266499:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266507:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266513:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266518:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266525:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266530:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266548:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266553:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266558:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266563:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266568:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266574:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266580:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266587:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266593:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266600:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266616:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266622:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266628:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266633:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266638:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266643:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266649:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266654:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266674:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266682:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266809:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266816:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266823:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266829:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266836:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266842:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266849:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266854:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266859:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266864:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266869:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266875:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266881:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266887:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266892:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266907:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266913:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266927:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266933:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266939:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266955:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266961:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266966:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266971:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.266983:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784186622.272599:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9b9ffe8d1000:6591] 1 exiting: rc = 0 00000100:00100000:2.0:1784186622.272886:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9b9ffe8f6e00:6590] 0 exiting: rc = 1 00000100:00100000:0.0:1784186622.273141:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273150:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273156:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273162:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273167:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273172:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273178:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273183:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273188:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273194:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273199:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273205:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273223:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273229:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273234:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273240:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273245:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273251:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273256:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273261:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273267:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273272:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273277:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273283:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273288:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273294:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273299:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273305:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273310:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273316:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273321:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273327:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273332:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273338:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273343:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273348:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273354:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273359:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273364:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273369:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273375:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273381:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273386:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273390:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273396:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273401:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273406:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273419:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273424:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273430:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273436:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273550:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273557:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273562:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273567:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273573:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273578:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273584:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273589:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273595:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273600:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273616:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273623:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.273629:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784186622.274675:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9b9ff70d8600:6592] 0 exiting: rc = 1 00000100:00100000:1.0:1784186622.274872:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9b9ff70d9400:6593] 1 exiting: rc = 0 00000100:00100000:0.0:1784186622.275101:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275122:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275129:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275136:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275142:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275148:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275154:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275160:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275167:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275173:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275180:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275186:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275192:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275213:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275220:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275226:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275232:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275237:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275252:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275258:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275264:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275271:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275277:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275283:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275289:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275310:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275317:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275323:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275329:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275335:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275345:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275351:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275358:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275364:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275371:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275378:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275385:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275406:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275414:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275419:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275425:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275432:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275438:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275485:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275490:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275496:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275503:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275509:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275515:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275536:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275543:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275550:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275555:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275568:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275575:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275582:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275591:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275596:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275602:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275621:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275628:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275650:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275658:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784186622.275665:0:13162:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1784186622.285904:0:13162:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1784186640.328926:0:13781:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1784186649.260563:0:14194:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784186649.260568:0:14194:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1784186649.260684:0:14194:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b9fc7fc5000 00000020:01000004:0.0:1784186649.260699:0:14194:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1784186649.260707:0:14194:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784186649.260722:0:14194:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9b9fc92719c0) 00000020:00000080:0.0:1784186649.260735:0:14194:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784186649.294170:0:14194:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1784186649.303693:0:14194:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1784186649.304146:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 354: rc = 0 00100000:10000000:3.0:1784186649.305558:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 354: rc = 0 00100000:10000000:3.0:1784186649.305754:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 354: rc = 0 00100000:10000000:3.0:1784186649.305850:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 354: rc = 0 00100000:10000000:3.0:1784186649.305942:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 354: rc = 0 00100000:10000000:3.0:1784186649.306127:0:14194:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1784186649.306212:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 354: rc = 0 00100000:10000000:3.0:1784186649.307940:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 356: rc = 0 00100000:10000000:3.0:1784186649.312638:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 491: rc = 0 00100000:10000000:3.0:1784186649.312828:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 491: rc = 0 00100000:10000000:3.0:1784186649.313222:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 499: rc = 0 00100000:10000000:3.0:1784186649.313699:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 499: rc = 0 00100000:10000000:3.0:1784186649.314021:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 499: rc = 0 00100000:10000000:3.0:1784186649.314789:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 499: rc = 0 00100000:10000000:3.0:1784186649.316224:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 499: rc = 0 00100000:10000000:3.0:1784186649.316536:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 499: rc = 0 00100000:10000000:3.0:1784186649.316807:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 499: rc = 0 00100000:10000000:3.0:1784186649.317037:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 499: rc = 0 00100000:10000000:2.0:1784186649.321782:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 499: rc = 0 00100000:10000000:2.0:1784186649.322121:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 499: rc = 0 00100000:10000000:2.0:1784186649.322534:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 499: rc = 0 00100000:10000000:2.0:1784186649.323523:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 499: rc = 0 00100000:10000000:2.0:1784186649.323965:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 632: rc = 0 00100000:10000000:2.0:1784186649.324212:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 632: rc = 0 00100000:10000000:2.0:1784186649.324479:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 632: rc = 0 00100000:10000000:2.0:1784186649.324709:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 632: rc = 0 00100000:10000000:2.0:1784186649.324936:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 632: rc = 0 00100000:10000000:2.0:1784186649.326320:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 632: rc = 0 00100000:10000000:2.0:1784186649.326627:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 632: rc = 0 00100000:10000000:2.0:1784186649.326948:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 632: rc = 0 00100000:10000000:2.0:1784186649.327223:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 632: rc = 0 00100000:10000000:2.0:1784186649.327632:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 632: rc = 0 00100000:10000000:2.0:1784186649.327887:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 632: rc = 0 00100000:10000000:2.0:1784186649.328090:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 632: rc = 0 00100000:10000000:2.0:1784186649.328411:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 632: rc = 0 00100000:10000000:2.0:1784186649.328671:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 632: rc = 0 00100000:10000000:2.0:1784186649.328912:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 632: rc = 0 00100000:10000000:2.0:1784186649.329146:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 632: rc = 0 00100000:10000000:2.0:1784186649.330946:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 632: rc = 0 00100000:10000000:2.0:1784186649.331230:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 632: rc = 0 00100000:10000000:2.0:1784186649.331589:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 632: rc = 0 00100000:10000000:2.0:1784186649.332006:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 632: rc = 0 00100000:10000000:2.0:1784186649.332348:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 632: rc = 0 00100000:10000000:2.0:1784186649.332894:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 632: rc = 0 00100000:10000000:2.0:1784186649.333134:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 632: rc = 0 00100000:10000000:2.0:1784186649.333584:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 632: rc = 0 00100000:10000000:2.0:1784186649.334141:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 632: rc = 0 00100000:10000000:2.0:1784186649.334575:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 632: rc = 0 00100000:10000000:2.0:1784186649.334839:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 632: rc = 0 00100000:10000000:2.0:1784186649.335082:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 632: rc = 0 00100000:10000000:2.0:1784186649.335819:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 632: rc = 0 00100000:10000000:2.0:1784186649.336377:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 632: rc = 0 00100000:10000000:2.0:1784186649.336699:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 632: rc = 0 00100000:10000000:2.0:1784186649.336939:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 632: rc = 0 00100000:10000000:2.0:1784186649.338020:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 641: rc = 0 00100000:10000000:2.0:1784186649.338648:0:14194:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1784186649.339082:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 496: rc = 0 00100000:10000000:2.0:1784186649.339426:0:14194:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1784186649.339570:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 496: rc = 0 00100000:10000000:2.0:1784186649.339873:0:14194:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1784186649.339932:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 496: rc = 0 00100000:10000000:2.0:1784186649.340374:0:14194:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1784186649.340526:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 492: rc = 0 00100000:10000000:2.0:1784186649.340788:0:14194:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1784186649.340850:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 492: rc = 0 00100000:10000000:2.0:1784186649.341016:0:14194:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1784186649.341076:0:14194:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 492: rc = 0 00000020:00000080:2.0:1784186649.341895:0:14194:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784186649.341903:0:14194:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784186649.341913:0:14194:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d1a0e6 00000020:01000004:2.0:1784186649.341921:0:14194:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1784186649.341926:0:14194:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784186649.341931:0:14194:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b9fc7fc5000 from MGS 00000020:01000004:2.0:1784186649.341934:0:14194:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784186649.341946:0:14194:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9b9ffeefcd40) 00000020:00000080:2.0:1784186649.341956:0:14194:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1784186649.342003:0:14194:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b9fc7fc5000 from MGS, refs=2 00080000:01000000:2.0:1784186649.342008:0:14194:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784186649.342012:0:14194:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d1a0f4 00000100:00100000:2.0:1784186649.342111:0:14194:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1784186649.342342:0:14194:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1784186649.342350:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1784186649.343034:0:14194:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1784186649.343042:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1784186649.343927:0:14194:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784186649.344074:0:14194:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1784186649.344080:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1784186649.344764:0:14194:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1784186649.344771:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1784186649.345136:0:14194:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1784186649.345141:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1784186649.346681:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186649.346686:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186649.346688:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186649.348352:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186649.348357:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186649.348371:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186649.348873:0:14194:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1784186649.363588:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1784186649.365126:0:14194:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1784186649.365144:0:14194:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784186649.365147:0:14194:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1784186649.376388:0:14203:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784186649.376658:0:14194:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784186649.376781:0:14194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784186649.377496:0:14194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784186649.377787:0:14194:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784186649.377946:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784186649.377952:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784186649.382359:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784186649.382377:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784186649.384553:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784186649.384571:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784186649.386572:0:14194:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784186649.386596:0:14194:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.131@tcp' 00000020:01000004:1.0:1784186649.386598:0:14194:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1784186649.386626:0:14194:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.131@tcp (typ=mgc) 00000020:00000080:1.0:1784186649.386638:0:14194:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.131@tcp (ffff9b9ec681cd40) 00000020:00000080:1.0:1784186649.386653:0:14194:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1784186649.386724:0:14194:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b9fd0dd5800@MGC192.168.201.131@tcp: add connection 192.168.201.131@tcp at head 00010000:00010000:1.0:1784186649.386872:0:14194:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.131@tcp-0 is initialized 00000040:01000000:1.0:1784186649.386878:0:14194:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 1 is initialized 00000100:00080000:3.0:1784186649.386983:0:14208:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1784186649.390340:0:14209:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1784186649.390420:0:14194:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.131@tcp (uuid fb25396a-5e10-4f60-be9a-8f767a2ae4fa) 00000020:00000080:1.0:1784186649.390466:0:14194:0:(genops.c:1406:class_connect()) connect: client fb25396a-5e10-4f60-be9a-8f767a2ae4fa, cookie 0x55bc3e8c99d1a102 00000100:00080000:1.0:1784186649.390478:0:14194:0:(import.c:510:import_select_connection()) MGC192.168.201.131@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784186649.390483:0:14194:0:(import.c:624:import_select_connection()) MGC192.168.201.131@tcp: import ffff9b9fd0dd5800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1784186649.390512:0:14194:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffe060700 x1870854937990528/t0(0) o250->MGC192.168.201.131@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784186649.390537:0:14194:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fb25396a-5e10-4f60-be9a-8f767a2ae4fa->MGS 00000020:01000004:1.0:1784186649.390555:0:14194:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784186649.390560:0:14194:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784186649.390573:0:14194:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9b9ec68199c0) 00000020:00000080:1.0:1784186649.390585:0:14194:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1784186649.391359:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3305:1870854937990528:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1784186649.391432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186649.391528:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937990528 00000100:00100000:3.0:1784186649.391534:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937990528 00000100:00100000:3.0:1784186649.391563:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784186649.391570:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1870854937990528:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1784186649.391592:0:14205:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from fb25396a-5e10-4f60-be9a-8f767a2ae4fa@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:3.0:1784186649.391616:0:14205:0:(genops.c:1406:class_connect()) connect: client fb25396a-5e10-4f60-be9a-8f767a2ae4fa, cookie 0x55bc3e8c99d1a110 00000100:00080000:3.0:1784186649.391727:0:14205:0:(import.c:65:import_set_state_nolock()) ffff9b9ec7552800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784186649.391782:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+5:3305:x1870854937990528:12345-0@lo:250:mount.lustre.0 Request processed in 210us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186649.391789:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784186649.391822:0:3305:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.131@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1784186649.391830:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.131@tcp: connect to target with instance 0 00000100:00080000:3.0:1784186649.391837:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.131@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1784186649.391840:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1784186649.391843:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fd0dd5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1784186649.391845:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1784186649.391852:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1784186649.391856:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3305:1870854937990528:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784186649.410325:0:14194:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784186649.410523:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784186649.410529:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1784186649.412129:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1784186649.412141:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784186649.412532:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1784186649.412539:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1784186649.413143:0:14194:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784186649.413361:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1784186649.413366:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1784186649.422685:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1784186649.422697:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1784186649.489852:0:14194:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784186649.490071:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1784186649.490078:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1784186649.491688:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1784186649.491698:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1784186649.492111:0:14194:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784186649.492279:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784186649.492283:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1784186649.492808:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784186649.492814:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1784186649.493657:0:14194:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784186649.493825:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784186649.493831:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1784186649.494710:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784186649.494718:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1784186649.495177:0:14194:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784186649.495707:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784186649.495713:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784186649.496066:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784186649.496072:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784186649.522558:0:14194:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784186649.522763:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784186649.522770:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784186649.524159:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784186649.524171:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1784186649.528655:0:14194:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784186649.528669:0:14194:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1784186649.529695:0:14194:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1784186649.529718:0:14194:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1784186649.529724:0:14194:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1784186649.529853:0:14194:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784186649.529883:0:14194:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.131@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1784186649.529888:0:14194:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784186649.529889:0:14194:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784186649.529891:0:14194:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186649.529892:0:14194:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186649.529893:0:14194:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186649.529895:0:14194:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186649.529896:0:14194:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784186649.529897:0:14194:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784186649.529899:0:14194:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186649.529900:0:14194:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784186649.529902:0:14194:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1784186649.529904:0:14194:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784186649.529906:0:14194:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784186649.529907:0:14194:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186649.529908:0:14194:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186649.529909:0:14194:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186649.529910:0:14194:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186649.529911:0:14194:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784186649.529912:0:14194:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784186649.529913:0:14194:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186649.529916:0:14194:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784186649.529939:0:14194:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784186649.529957:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937990656:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784186649.530023:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.530097:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec913c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186649.530211:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937990656 00000100:00100000:0.0:1784186649.530218:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937990656 00000100:00100000:0.0:1784186649.530394:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784186649.530403:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+5:14194:x1870854937990656:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784186649.530489:0:14207:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784186649.530492:0:14207:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784186649.530495:0:14207:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1784186649.530782:0:14228:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784186649.531089:0:14207:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1784186649.532162:0:14229:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1784186649.532168:0:14229:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1784186649.532171:0:14229:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1784186649.532205:0:14229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1784186649.532658:0:14207:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784186649.532668:0:14207:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1784186649.548788:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+5:14194:x1870854937990656:12345-0@lo:253:mount.lustre.0 Request processed in 18376us (18753us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186649.548804:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784186649.550555:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937990656:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784186649.550574:0:14194:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784186649.550578:0:14194:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784186649.550580:0:14194:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784186649.550581:0:14194:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186649.550582:0:14194:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186649.550584:0:14194:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186649.550585:0:14194:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186649.550586:0:14194:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784186649.550588:0:14194:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784186649.550590:0:14194:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186649.550591:0:14194:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784186649.550616:0:14194:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b9fc7fc5000 from lustre-MDT0000 10000000:01000000:2.0:1784186649.550639:0:14194:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784186649.550641:0:14194:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784186649.550644:0:14194:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9b9ec681cd40 10000000:01000000:2.0:1784186649.550649:0:14194:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784186649.550656:0:14194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9b9ec681cd40 from 1 10000000:01000000:2.0:1784186649.550658:0:14194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784186649.550695:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.550706:0:14194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.550716:0:14194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186649.550735:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937990784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784186649.550804:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.550846:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec91780 going to sleep for 11 seconds 00000100:00100000:3.0:1784186649.550967:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937990784 00000100:00100000:3.0:1784186649.550972:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937990784 00000100:00100000:3.0:1784186649.551008:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784186649.551015:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+5:14194:x1870854937990784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784186649.551025:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186649.551035:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda505000/0x55bc3e8c99d1a11e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a117 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.551054:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda505000/0x55bc3e8c99d1a11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a117 expref: 6 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.551061:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda505000/0x55bc3e8c99d1a11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a117 expref: 6 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.551068:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505000, rc 0) 00000100:00100000:3.0:1784186649.551093:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+6:14194:x1870854937990784:12345-0@lo:101:mount.lustre.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186649.551098:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784186649.551186:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937990784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784186649.551198:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a11e expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.551207:0:14194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a11e expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186649.551251:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937990912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186649.551267:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.551286:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec91780 going to sleep for 11 seconds 00000100:00100000:0.0:1784186649.551400:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937990912 00000100:00100000:0.0:1784186649.551404:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937990912 00000100:00100000:0.0:1784186649.551426:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784186649.551431:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+6:14194:x1870854937990912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784186649.551642:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+6:14194:x1870854937990912:12345-0@lo:501:mount.lustre.0 Request processed in 210us (373us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784186649.551647:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784186649.551760:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937990912:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784186649.551782:0:14194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784186649.551800:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a11e expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.551809:0:14194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a11e expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186649.551815:0:14194:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b9fc7fc5000 10000000:01000000:2.0:1784186649.551818:0:14194:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784186649.551821:0:14194:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9b9fc7fc5000 10000000:01000000:2.0:1784186649.551822:0:14194:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784186649.551824:0:14194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9b9fc7fc5000 from 1 10000000:01000000:2.0:1784186649.551826:0:14194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784186649.551839:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c200/0x55bc3e8c99d1a125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.551848:0:14194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c200/0x55bc3e8c99d1a125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.551853:0:14194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c200/0x55bc3e8c99d1a125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186649.551861:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937991040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784186649.551879:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.551891:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec91780 going to sleep for 11 seconds 00000100:00100000:0.0:1784186649.552040:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937991040 00000100:00100000:0.0:1784186649.552043:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937991040 00000100:00100000:0.0:1784186649.552066:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784186649.552070:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+6:14194:x1870854937991040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784186649.552076:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186649.552085:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ec58fa000/0x55bc3e8c99d1a12c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a125 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186649.552095:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58fa000/0x55bc3e8c99d1a12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a125 expref: 7 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186649.552101:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ec58fa000/0x55bc3e8c99d1a12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a125 expref: 7 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186649.552110:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fa000, rc 0) 00000100:00100000:0.0:1784186649.552138:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+7:14194:x1870854937991040:12345-0@lo:101:mount.lustre.0 Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186649.552143:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784186649.552218:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937991040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784186649.552225:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c200/0x55bc3e8c99d1a125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a12c expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.552239:0:14194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c200/0x55bc3e8c99d1a125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a12c expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186649.552246:0:14194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784186649.552260:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c200/0x55bc3e8c99d1a125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a12c expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.552265:0:14194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c200/0x55bc3e8c99d1a125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a12c expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186649.552268:0:14194:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784186649.552271:0:14194:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784186649.552274:0:14194:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9b9fc7fc5000 10000000:01000000:3.0:1784186649.552275:0:14194:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784186649.552277:0:14194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784186649.552278:0:14194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784186649.552289:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda504a00/0x55bc3e8c99d1a133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.552299:0:14194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fda504a00/0x55bc3e8c99d1a133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.552304:0:14194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fda504a00/0x55bc3e8c99d1a133 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186649.552311:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937991168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784186649.552329:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186649.552344:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937991168 00000100:00100000:3.0:1784186649.552346:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937991168 00000100:00100000:3.0:1784186649.552361:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186649.552365:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+7:14194:x1870854937991168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784186649.552369:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186649.552374:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d1a13a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a133 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.552388:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d1a13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a133 expref: 8 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.552393:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda504600/0x55bc3e8c99d1a13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a133 expref: 8 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.552397:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda504600, rc 0) 00000100:00100000:3.0:1784186649.552412:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+8:14194:x1870854937991168:12345-0@lo:101:mount.lustre.0 Request processed in 47us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186649.552416:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186649.552437:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc2b5d900 going to sleep for 11 seconds 00000100:00100000:3.0:1784186649.552467:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937991168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784186649.552477:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fda504a00/0x55bc3e8c99d1a133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a13a expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.552483:0:14194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fda504a00/0x55bc3e8c99d1a133 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a13a expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186649.552520:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937991296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784186649.552542:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186649.552559:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937991296 00000100:00100000:3.0:1784186649.552562:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937991296 00000100:00100000:3.0:1784186649.552580:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784186649.552586:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+8:14194:x1870854937991296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784186649.552846:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+9:14194:x1870854937991296:12345-0@lo:501:mount.lustre.0 Request processed in 260us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186649.552857:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784186649.552874:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc2b5d900 going to sleep for 11 seconds 00000100:00100000:3.0:1784186649.552882:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937991296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784186649.552907:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937991424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784186649.552931:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186649.552943:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937991424 00000100:00100000:3.0:1784186649.552946:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937991424 00000100:00100000:3.0:1784186649.552958:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784186649.552961:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+9:14194:x1870854937991424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784186649.553170:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+9:14194:x1870854937991424:12345-0@lo:503:mount.lustre.0 Request processed in 207us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186649.553175:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784186649.553203:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc2b5d900 going to sleep for 11 seconds 00000100:00100000:3.0:1784186649.553214:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937991424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784186649.554909:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14230:1870854937991552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186649.554957:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186649.555013:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb3cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784186649.558120:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937991552 00000100:00100000:0.0:1784186649.558134:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937991552 00000100:00100000:0.0:1784186649.558247:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784186649.558256:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+9:14230:x1870854937991552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186649.559015:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+9:14230:x1870854937991552:12345-0@lo:502:llog_process_th.0 Request processed in 757us (4053us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186649.559025:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784186649.559115:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14230:1870854937991552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784186649.559150:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186649.559170:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.559173:0:14230:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784186649.559178:0:14230:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784186649.559181:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784186649.559195:0:14230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9b9ffeef8000) 00000020:00000080:2.0:1784186649.559214:0:14230:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1784186649.559219:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784186649.559312:0:14230:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784186649.559319:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d1a148 00000020:00000080:2.0:1784186649.559573:0:14230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784186649.559578:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186649.559582:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.559583:0:14230:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784186649.559586:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186649.559589:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.559590:0:14230:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784186649.559594:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784186649.559601:0:14230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9b9ffeefb380) 00000020:00000080:2.0:1784186649.559622:0:14230:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784186649.559627:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784186649.559630:0:14230:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784186649.559632:0:14230:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784186649.559638:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784186649.559681:0:14230:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b9fc7fc5000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784186649.559693:0:14230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9b9ffeef99c0) 00000020:00000080:2.0:1784186649.559702:0:14230:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1784186649.559749:0:14230:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784186649.559756:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x55bc3e8c99d1a15d 00000020:00000080:2.0:1784186649.559844:0:14230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784186649.559850:0:14230:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784186649.559854:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x55bc3e8c99d1a164 00080000:01000000:2.0:1784186649.559859:0:14230:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784186649.559862:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d1a16b 00010000:00010000:2.0:1784186649.626557:0:14230:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1784186649.626915:0:14230:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1784186649.627042:0:14230:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784186649.627587:0:14230:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ba001a54d40) 00000020:00000080:2.0:1784186649.627603:0:14230:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784186649.627652:0:14230:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784186649.627657:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d1a179 00000020:00000080:3.0:1784186649.629940:0:14230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784186649.633816:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x55bc3e8c99d1a180 00000020:00000080:2.0:1784186649.634255:0:14230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1784186649.634271:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186649.634277:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.634279:0:14230:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1784186649.634282:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186649.634289:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.634290:0:14230:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1784186649.634294:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1784186649.634333:0:14230:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1784186649.634345:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186649.634353:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.634355:0:14230:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1784186649.634358:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784186649.634360:0:14230:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1784186649.634362:0:14230:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784186649.634363:0:14230:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784186649.634365:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784186649.634367:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.634368:0:14230:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784186649.634370:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784186649.634373:0:14230:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1784186649.634377:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.634378:0:14230:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784186649.634381:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784186649.634385:0:14230:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:2.0:1784186649.634411:0:14230:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784186649.634413:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784186649.634428:0:14230:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ba001a519c0) 00000020:00000080:2.0:1784186649.634460:0:14230:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1784186649.634465:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784186649.634650:0:14230:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784186649.634656:0:14230:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1784186649.634663:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d1a18e 00010000:00080000:2.0:1784186649.634694:0:14230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b9fc4aa0800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1784186649.634917:0:14230:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1784186649.635281:0:14230:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784186649.635326:0:14230:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784186649.644954:0:14230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784186649.645032:0:14230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1784186649.645126:0:14230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1784186649.648493:0:14234:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784186649.648512:0:14234:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784186649.653625:0:14230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784186649.653642:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784186649.654222:0:14230:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784186649.654246:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x55bc3e8c99d1a195 00000100:00080000:3.0:1784186649.654266:0:14230:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784186649.654272:0:14230:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b9fc4aa0800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:3.0:1784186649.654306:0:14230:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffeeb4e00 x1870854937991680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784186649.654398:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937991680:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784186649.654483:0:3305:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870854937991680 offset 0 length 520: 4 00000100:00080000:3.0:1784186649.654893:0:14230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1784186649.668252:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186649.668263:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186649.668265:0:14230:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784186649.668270:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784186649.668273:0:14230:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1784186649.668275:0:14230:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784186649.668277:0:14230:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784186649.668278:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784186649.668281:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186649.668282:0:14230:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784186649.668285:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784186649.668290:0:14230:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1784186649.668294:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186649.668296:0:14230:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784186649.668299:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784186649.668303:0:14230:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.131@tcp to nid 0x20000c0a8c983 (192.168.201.131@tcp) 00000020:01000000:3.0:1784186649.668332:0:14230:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784186649.668334:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784186649.668351:0:14230:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9b9fd1854d40) 00000020:00000080:3.0:1784186649.668373:0:14230:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1784186649.668380:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784186649.668483:0:14230:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1784186649.668489:0:14230:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1784186649.668495:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x55bc3e8c99d1a1a3 00010000:00080000:3.0:1784186649.668765:0:14230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b9ffeb88000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:3.0:1784186649.669005:0:14230:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1784186649.669237:0:14230:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784186649.669260:0:14230:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1784186649.670365:0:14230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784186649.670437:0:14230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1784186649.670970:0:14230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1784186649.671543:0:14236:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784186649.671548:0:14236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784186649.672940:0:14230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784186649.672954:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784186649.672996:0:14230:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784186649.673015:0:14230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x55bc3e8c99d1a1aa 00000100:00080000:2.0:1784186649.673027:0:14230:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784186649.673033:0:14230:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b9ffeb88000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1784186649.673069:0:14230:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffeeb3480 x1870854937991808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784186649.673228:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937991808:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1784186649.673284:0:3305:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870854937991808 offset 0 length 520: 4 00000100:00080000:2.0:1784186649.673341:0:14230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784186649.673406:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186649.673410:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.673412:0:14230:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784186649.673415:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186649.673419:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.673420:0:14230:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784186649.673423:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784186649.673425:0:14230:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784186649.673427:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186649.673429:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.673430:0:14230:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784186649.673433:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186649.673435:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.673436:0:14230:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784186649.673462:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784186649.673492:0:14230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14230:1870854937991936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784186649.673559:0:14230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.673835:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937991936 00000100:00100000:2.0:1784186649.673842:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937991936 00000100:00100000:2.0:1784186649.673883:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784186649.673892:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+9:14230:x1870854937991936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784186649.674410:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+9:14230:x1870854937991936:12345-0@lo:502:llog_process_th.0 Request processed in 517us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186649.674430:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784186649.674706:0:14230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186649.674728:0:14230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14230:1870854937991936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784186649.674757:0:14230:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186649.674763:0:14230:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186649.674764:0:14230:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784186649.674768:0:14230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1784186649.674913:0:14194:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1784186649.674932:0:14194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784186649.674956:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda504a00/0x55bc3e8c99d1a133 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a13a expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.674968:0:14194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fda504a00/0x55bc3e8c99d1a133 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a13a expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186649.674975:0:14194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b9fc7fc5000 from 1 10000000:01000000:3.0:1784186649.674978:0:14194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784186649.675008:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.675016:0:14194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.675027:0:14194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186649.675047:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784186649.675089:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186649.675116:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0f75b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784186649.675274:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937992064 00000100:00100000:2.0:1784186649.675279:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937992064 00000100:00100000:2.0:1784186649.675314:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784186649.675321:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+9:14194:x1870854937992064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784186649.675331:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186649.675347:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc766ce00/0x55bc3e8c99d1a1b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a1b1 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.675371:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766ce00/0x55bc3e8c99d1a1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a1b1 expref: 10 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.675382:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc766ce00/0x55bc3e8c99d1a1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a1b1 expref: 10 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.675390:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766ce00, rc 0) 00000100:00100000:2.0:1784186649.675517:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+10:14194:x1870854937992064:12345-0@lo:101:mount.lustre.0 Request processed in 196us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186649.675524:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784186649.677125:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784186649.677282:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186649.677295:0:14194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186649.678231:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992192:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784186649.678300:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186649.678387:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb2f26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186649.679294:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937992192 00000100:00100000:2.0:1784186649.679303:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937992192 00000100:00100000:2.0:1784186649.679408:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784186649.679428:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+10:14194:x1870854937992192:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784186649.679466:0:14207:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784186649.679472:0:14207:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784186649.680057:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+10:14194:x1870854937992192:12345-0@lo:256:mount.lustre.0 Request processed in 629us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186649.680068:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784186649.680169:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992192:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784186649.680848:0:14194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784186649.680877:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186649.680891:0:14194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186649.680901:0:14194:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc7fc5000 from 1 10000000:01000000:1.0:1784186649.680904:0:14194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784186649.680942:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186649.680951:0:14194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186649.681013:0:14194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186649.681035:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784186649.681076:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186649.682412:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb2f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186649.682532:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937992320 00000100:00100000:0.0:1784186649.682541:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937992320 00000100:00100000:0.0:1784186649.682852:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784186649.682863:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+10:14194:x1870854937992320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784186649.682879:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186649.682899:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a1c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a1bf expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186649.682927:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a1c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a1bf expref: 11 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186649.682949:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a1c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a1bf expref: 11 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186649.682959:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fac00, rc 0) 00000100:00100000:0.0:1784186649.683023:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14194:x1870854937992320:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186649.683030:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784186649.683126:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784186649.683164:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186649.683173:0:14194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186649.683234:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784186649.683266:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186649.683294:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb2f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186649.683463:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937992448 00000100:00100000:0.0:1784186649.683468:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937992448 00000100:00100000:0.0:1784186649.683487:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784186649.683493:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14194:x1870854937992448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784186649.684064:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14194:x1870854937992448:12345-0@lo:501:mount.lustre.0 Request processed in 569us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186649.684072:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784186649.684187:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784186649.684221:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784186649.684261:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186649.684290:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb2f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186649.684402:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937992576 00000100:00100000:0.0:1784186649.684407:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937992576 00000100:00100000:0.0:1784186649.684429:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784186649.684435:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14194:x1870854937992576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784186649.684853:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14194:x1870854937992576:12345-0@lo:503:mount.lustre.0 Request processed in 418us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186649.684859:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784186649.684932:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784186649.685384:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14238:1870854937992704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784186649.685425:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186649.685514:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb2f2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784186649.685628:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937992704 00000100:00100000:3.0:1784186649.685635:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937992704 00000100:00100000:0.0:1784186649.686294:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784186649.686306:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14238:x1870854937992704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784186649.686849:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14238:x1870854937992704:12345-0@lo:502:llog_process_th.0 Request processed in 545us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186649.686868:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784186649.686929:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14238:1870854937992704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186649.686959:0:14238:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186649.686966:0:14238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186649.686968:0:14238:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784186649.686973:0:14238:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9fc7fc5000 00000020:00000080:0.0:1784186649.686975:0:14238:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784186649.686980:0:14238:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186649.686981:0:14238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186649.686982:0:14238:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784186649.686984:0:14238:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186649.686985:0:14238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186649.686986:0:14238:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784186649.686988:0:14238:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9fc7fc5000 00000020:00000080:0.0:1784186649.686989:0:14238:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784186649.687063:0:14238:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186649.687066:0:14238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186649.687067:0:14238:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784186649.687068:0:14238:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186649.687070:0:14238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186649.687071:0:14238:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784186649.687073:0:14238:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b9fc7fc5000 00000020:00000080:0.0:1784186649.687074:0:14238:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784186649.687212:0:14238:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14238:1870854937992832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784186649.687473:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186649.687550:0:14238:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffeca9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186649.687620:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937992832 00000100:00100000:3.0:1784186649.687626:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937992832 00000100:00100000:3.0:1784186649.687698:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784186649.687706:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14238:x1870854937992832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186649.687905:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14238:x1870854937992832:12345-0@lo:502:llog_process_th.0 Request processed in 200us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186649.687913:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784186649.688176:0:14238:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14238:1870854937992832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784186649.688200:0:14238:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186649.688205:0:14238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186649.688206:0:14238:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784186649.688210:0:14238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1784186649.688692:0:14194:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1784186649.688711:0:14194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784186649.688759:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.688771:0:14194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186649.688812:0:14194:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784186649.688815:0:14194:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b9fc7fc5000 10000000:01000000:2.0:1784186649.688818:0:14194:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b9fc7fc5000 10000000:01000000:2.0:1784186649.688822:0:14194:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784186649.688827:0:14194:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9fc7fc5000 from 1 10000000:01000000:2.0:1784186649.688830:0:14194:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784186649.688858:0:14194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766dc00/0x55bc3e8c99d1a1cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.688866:0:14194:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc766dc00/0x55bc3e8c99d1a1cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.688876:0:14194:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc766dc00/0x55bc3e8c99d1a1cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186649.688892:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784186649.688938:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.688972:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186649.689015:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937992960 00000100:00100000:0.0:1784186649.689025:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937992960 00000100:00100000:0.0:1784186649.689059:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784186649.689066:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14194:x1870854937992960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784186649.689076:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186649.689087:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ec58fbc00/0x55bc3e8c99d1a1d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a1cd expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186649.689107:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58fbc00/0x55bc3e8c99d1a1d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a1cd expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186649.689117:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ec58fbc00/0x55bc3e8c99d1a1d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a1cd expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186649.689126:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fbc00, rc 0) 00000100:00100000:0.0:1784186649.689166:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14194:x1870854937992960:12345-0@lo:101:mount.lustre.0 Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186649.689172:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784186649.689244:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937992960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784186649.689258:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc766dc00/0x55bc3e8c99d1a1cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1d4 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.689267:0:14194:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766dc00/0x55bc3e8c99d1a1cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a1d4 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186649.689323:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937993088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186649.689345:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.689359:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186649.689737:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937993088 00000100:00100000:3.0:1784186649.689741:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937993088 00000100:00100000:3.0:1784186649.689768:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784186649.689774:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14194:x1870854937993088:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784186649.690069:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14194:x1870854937993088:12345-0@lo:501:mount.lustre.0 Request processed in 294us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186649.690076:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784186649.690130:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937993088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186649.690169:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937993216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784186649.690204:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.690500:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186649.690546:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937993216 00000100:00100000:3.0:1784186649.690551:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937993216 00000100:00100000:3.0:1784186649.690610:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784186649.690618:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14194:x1870854937993216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784186649.690758:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14194:x1870854937993216:12345-0@lo:503:mount.lustre.0 Request processed in 140us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186649.690764:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784186649.690825:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937993216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784186649.690979:0:14240:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14240:1870854937993344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784186649.691013:0:14240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.691028:0:14240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe5411000 going to sleep for 11 seconds 00000100:00100000:3.0:1784186649.691060:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937993344 00000100:00100000:3.0:1784186649.691064:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937993344 00000100:00100000:3.0:1784186649.691116:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784186649.691123:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14240:x1870854937993344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784186649.691502:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14240:x1870854937993344:12345-0@lo:502:llog_process_th.0 Request processed in 378us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186649.691517:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784186649.691588:0:14240:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14240:1870854937993344:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784186649.691645:0:14240:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784186649.691661:0:14240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ba001a53380) 00000020:00000080:2.0:1784186649.691682:0:14240:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1784186649.691836:0:14240:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b9fc7fc5000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784186649.691844:0:14240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b9fc7fc5000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784186649.691847:0:14240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9fc7fc5000 4 00010000:00080000:2.0:1784186649.691875:0:14240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b9fd10ff000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1784186649.694984:0:14240:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1784186649.695086:0:14240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784186649.695123:0:14240:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784186649.695134:0:14240:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x55bc3e8c99d1a1e2 00000100:00080000:2.0:1784186649.695145:0:14240:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784186649.696541:0:14240:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b9fd10ff000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1784186649.696585:0:14240:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffeeb3100 x1870854937993472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784186649.696621:0:14240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784186649.696833:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870854937993472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784186649.696909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186649.696979:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937993472 00000100:00100000:0.0:1784186649.696985:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937993472 00000100:00100000:0.0:1784186649.698272:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784186649.698282:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1870854937993472:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784186649.698372:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1870854937993472:12345-0@lo:38:llog_process_th.0 Request processed in 89us (1463us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784186649.698380:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784186649.698425:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784186649.698433:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fd10ff000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784186649.698458:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784186649.698462:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870854937993472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784186649.701537:0:14240:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14240:1870854937993600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784186649.701618:0:14240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.701659:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937993600 00000100:00100000:2.0:1784186649.701666:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937993600 00000100:00100000:2.0:1784186649.701709:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784186649.701717:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14240:x1870854937993600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784186649.701952:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14240:x1870854937993600:12345-0@lo:502:llog_process_th.0 Request processed in 235us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186649.701960:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784186649.702011:0:14240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a580c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186649.702033:0:14240:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14240:1870854937993600:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784186649.702062:0:14240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784186649.702118:0:14194:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1784186649.702136:0:14194:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784186649.703391:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766dc00/0x55bc3e8c99d1a1cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1d4 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.703416:0:14194:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc766dc00/0x55bc3e8c99d1a1cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1d4 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784186649.703488:0:14194:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784186649.703490:0:14194:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784186649.703491:0:14194:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186649.703493:0:14194:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186649.703494:0:14194:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186649.703495:0:14194:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186649.703496:0:14194:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784186649.703498:0:14194:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784186649.703500:0:14194:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186649.703501:0:14194:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784186649.703506:0:14194:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784186649.703509:0:14194:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784186649.703510:0:14194:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784186649.703511:0:14194:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186649.703512:0:14194:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186649.703513:0:14194:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186649.703514:0:14194:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186649.703515:0:14194:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784186649.703516:0:14194:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784186649.703517:0:14194:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186649.703518:0:14194:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784186649.703543:0:14194:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784186649.703562:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937993728:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784186649.703623:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.703666:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec913c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186649.703795:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937993728 00000100:00100000:3.0:1784186649.703802:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937993728 00000100:00100000:3.0:1784186649.703875:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784186649.703884:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14194:x1870854937993728:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784186649.703910:0:14206:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784186649.703924:0:14206:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784186649.755316:0:14206:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784186649.755337:0:14206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784186649.755371:0:14228:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784186649.755376:0:14228:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784186649.755399:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.755418:0:14228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc766ce00/0x55bc3e8c99d1a1b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a1b1 expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.755455:0:14228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.755496:0:14228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc766ce00/0x55bc3e8c99d1a1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d1a1b1 expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.755512:0:14228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9fc766ce00/0x55bc3e8c99d1a1b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1b1 expref: 12 pid: 14206 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186649.755528:0:14228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14228:1870854937993856:0@lo:104: 00000100:00100000:2.0:1784186649.755604:0:14228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.755643:0:14228:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc5fa03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186649.755683:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937993856 00000100:00100000:2.0:1784186649.755690:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937993856 00000100:00100000:2.0:1784186649.755737:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784186649.755745:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+3:14228:x1870854937993856:12345-0@lo:104: 00010000:00010000:2.0:1784186649.755758:0:14195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.755813:0:14195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784186649.755819:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+3:14228:x1870854937993856:12345-0@lo:104: Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186649.755826:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784186649.755840:0:14228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14228:1870854937993856:0@lo:104: 00010000:00010000:2.0:1784186649.755847:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186649.755853:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186649.755858:0:14228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.755859:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505e00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:2.0:1784186649.755869:0:14201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.755877:0:14201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186649.755884:0:14201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186649.755891:0:14201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784186649.755922:0:14201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.755929:0:14201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784186649.755947:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.755954:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a1b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a1b8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.755968:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186649.755970:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186649.755972:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186649.755992:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3306:1870854937993984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784186649.756016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186649.756067:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937993984 00000100:00100000:2.0:1784186649.756071:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937993984 00010000:00010000:2.0:1784186649.756085:0:14197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc766ce00/0x55bc3e8c99d1a1b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1b1 expref: 13 pid: 14206 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186649.756106:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784186649.756118:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+13:3306:x1870854937993984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784186649.756141:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186649.756146:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc766ce00/0x55bc3e8c99d1a1b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1b1 expref: 13 pid: 14206 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.756166:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc766ce00/0x55bc3e8c99d1a1b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1b1 expref: 13 pid: 14206 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.756180:0:14197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc766ce00/0x55bc3e8c99d1a1b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1b1 expref: 13 pid: 14206 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.756193:0:14197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.756200:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784186649.756212:0:14197:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000836436s 00010000:00010000:2.0:1784186649.756216:0:14197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.756223:0:14197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.756231:0:14197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.756237:0:14197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.756242:0:14197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186649.756252:0:14197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.756259:0:14197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.756276:0:14197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.756286:0:14228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186649.756286:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186649.756294:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186649.756301:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc766c600/0x55bc3e8c99d1a1e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186649.756322:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:3306:x1870854937993984:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186649.756329:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784186649.756356:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3306:1870854937993984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784186649.763190:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14194:x1870854937993728:12345-0@lo:253:mount.lustre.0 Request processed in 59297us (59556us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186649.763206:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784186649.763339:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14194:1870854937993728:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784186649.763357:0:14194:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784186649.763361:0:14194:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784186649.763362:0:14194:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784186649.763364:0:14194:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784186649.763365:0:14194:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784186649.763366:0:14194:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784186649.763367:0:14194:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784186649.763368:0:14194:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784186649.763370:0:14194:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784186649.763372:0:14194:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784186649.763373:0:14194:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784186649.763390:0:14194:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784186649.772938:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1784186649.773113:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784186649.773416:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1784186649.773615:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784186649.774008:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1784186649.774170:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1784186649.775183:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1784186649.775352:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1784186649.775766:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1784186649.775989:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1784186649.776249:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1784186649.776402:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1784186649.802014:0:14194:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1784186649.802736:0:14194:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1784186649.803311:0:14251:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1784186649.803391:0:14251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1784186649.808856:0:14194:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784186649.809015:0:14194:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1784186649.809783:0:14250:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1784186649.809788:0:14250:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1784186649.810067:0:14251:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784186649.810143:0:14251:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784186649.810158:0:14251:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:0.0:1784186649.811034:0:14194:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784186649.811185:0:14194:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784186649.811477:0:14194:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784186649.813195:0:14194:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784186649.814157:0:14194:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784186649.814203:0:14194:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1784186649.817174:0:14194:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1784186649.823863:0:14194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1784186649.858080:0:14194:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784186649.858122:0:14194:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab9e81e03988 00100000:10000000:1.0:1784186649.858131:0:14194:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1784186649.859399:0:14194:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784186649.859415:0:14194:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784186649.859427:0:14194:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784186649.859466:0:14194:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1784186650.366647:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784186650.750982:0:14246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1784186651.203612:0:14209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784186651.203621:0:14209:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b9fc7fc5000 from 6 10000000:01000000:1.0:1784186651.203626:0:14209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784186651.203686:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186651.203700:0:14209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186651.203719:0:14209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186651.203745:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937994112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784186651.203809:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186651.203865:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186651.204272:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937994112 00000100:00100000:3.0:1784186651.204279:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937994112 00000100:00100000:3.0:1784186651.204343:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784186651.204352:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14209:x1870854937994112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784186651.204366:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186651.204379:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a1f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a1f0 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186651.204402:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a1f0 expref: 12 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186651.204412:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a1f0 expref: 12 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186651.204420:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505a00, rc 0) 00000100:00100000:3.0:1784186651.204500:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14209:x1870854937994112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186651.204506:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784186651.206651:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937994112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784186651.206689:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186651.206702:0:14209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186651.206771:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937994240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784186651.206836:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186651.206867:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186651.207008:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937994240 00000100:00100000:3.0:1784186651.207016:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937994240 00000100:00100000:3.0:1784186651.207066:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784186651.207075:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14209:x1870854937994240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784186651.207096:0:14206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784186651.207113:0:14206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784186651.207116:0:14206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1784186651.207219:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14209:x1870854937994240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186651.207226:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784186651.207485:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937994240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784186651.207529:0:14209:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784186651.207538:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186651.207548:0:14209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186651.395579:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784186651.775404:0:14246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784186652.419928:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186653.444805:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186654.464757:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784186654.760352:0:14493:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1784186654.914303:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784186654.914310:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784186654.914313:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784186654.914315:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784186654.914318:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784186654.914333:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784186654.914337:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b9fd10ff000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784186654.914350:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9b9fd10ff000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1784186654.914375:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffeeb1880 x1870854937994496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784186654.914432:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784186654.914466:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3306:1870854937994368:0@lo:400:kworker.0 00000100:00100000:2.0:1784186654.914539:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186654.914646:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937994368 00000100:00100000:2.0:1784186654.914654:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937994368 00000100:00100000:2.0:1784186654.914699:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784186654.914708:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:3306:x1870854937994368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186654.914761:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:3306:x1870854937994368:12345-0@lo:400:kworker.0 Request processed in 54us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186654.914768:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784186654.914815:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3306:1870854937994368:0@lo:400:kworker.0 00000100:00100000:1.0:1784186654.933298:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870854937994496:0@lo:38:kworker.0 00000100:00100000:1.0:1784186654.933392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186654.933551:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937994496 00000100:00100000:3.0:1784186654.933561:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937994496 00000100:00100000:3.0:1784186654.933622:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784186654.933629:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1870854937994496:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784186654.933661:0:14214:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:3.0:1784186654.933697:0:14214:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x55bc3e8c99d1a1fe 00000004:00100000:3.0:1784186654.933713:0:14214:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784186654.933861:0:14214:0:(import.c:65:import_set_state_nolock()) ffff9b9fefbd9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784186654.933935:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1870854937994496:12345-0@lo:38:kworker.0 Request processed in 305us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186654.933943:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784186654.934281:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b9ffeeb1880 x1870854937994496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784186664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784186654.934299:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784186654.934306:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784186654.934312:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784186654.934314:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fd10ff000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784186654.934319:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1870854937994496:0@lo:38:kworker.0 00010000:00010000:0.0:1784186655.505329:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186656.513375:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186657.533680:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784186657.870186:0:14644:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf36017a0 20000000:00000080:1.0:1784186657.870205:0:14644:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b9ffcd51c00 uarg=0000000000000000 20000000:01000000:1.0:1784186657.870243:0:14644:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784186657.870250:0:14644:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784186657.870255:0:14644:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1784186657.871310:0:14645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1784186657.871592:0:14644:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784186657.880363:0:14644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784186657.882695:0:14644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186657.882774:0:14644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a1c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a1bf expref: 11 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186657.882783:0:14644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186657.882842:0:14644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a1c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d1a1bf expref: 11 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186657.882891:0:14644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a1c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1bf expref: 11 pid: 14206 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186657.882907:0:14644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14644:1870854937994624:0@lo:104: 00000100:00100000:0.0:1784186657.882973:0:14644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186657.883042:0:14644:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0f75cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186657.883305:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937994624 00000100:00100000:1.0:1784186657.883312:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937994624 00000100:00100000:1.0:1784186657.883363:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784186657.883373:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+3:14644:x1870854937994624:12345-0@lo:104: 00010000:00010000:1.0:1784186657.883386:0:14196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186657.883476:0:14196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784186657.883482:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+3:14644:x1870854937994624:12345-0@lo:104: Request processed in 111us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186657.883490:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1784186657.883687:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186657.883694:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.883702:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27eda00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:2.0:1784186657.883706:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.883714:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784186657.883729:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186657.883734:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784186657.883771:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.883777:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784186657.883798:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.883805:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eda00/0x55bc3e8c99d1a1bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a1c6 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.883821:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186657.883822:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186657.883824:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186657.883846:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854937994752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784186657.883877:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186657.883911:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937994752 00000100:00100000:2.0:1784186657.883914:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937994752 00010000:00010000:2.0:1784186657.883931:0:14197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a1c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1bf expref: 12 pid: 14206 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186657.883953:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784186657.883959:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:3308:x1870854937994752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784186657.883969:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186657.883975:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a1c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1bf expref: 12 pid: 14206 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.884002:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a1c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1bf expref: 12 pid: 14206 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.884026:0:14197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.884034:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.884048:0:14197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.884055:0:14197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.884061:0:14197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.884067:0:14197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.884072:0:14197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186657.884076:0:14197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.884083:0:14197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.884099:0:14197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186657.884126:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186657.884154:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:3308:x1870854937994752:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186657.884160:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784186657.884196:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854937994752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784186657.884566:0:14644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a1c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1bf expref: 11 pid: 14206 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186657.884576:0:14644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14644:1870854937994624:0@lo:104: 00010000:00010000:0.0:1784186657.884589:0:14644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186657.884598:0:14644:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186657.884603:0:14644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186657.884609:0:14644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ec58fa200/0x55bc3e8c99d1a205 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186658.558614:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784186659.017325:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784186649/real 1784186649] req@ffff9b9ffeeb3480 x1870854937991808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784186659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186659.017358:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b9ffeeb3480 x1870854937991808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784186659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186659.017403:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784186649/real 1784186649] req@ffff9b9ffeeb4e00 x1870854937991680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784186659 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186659.017415:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b9ffeeb4e00 x1870854937991680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784186659 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784186659.017433:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeb88000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784186659.018538:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784186659.018545:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937991808:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1784186659.018554:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fc4aa0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784186659.018562:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784186659.018564:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937991680:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1784186659.018715:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784186659.018720:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784186659.018722:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b9fc4aa0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784186659.018727:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1784186659.018732:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784186659.018739:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b9fc4aa0800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1784186659.018761:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffe063800 x1870854937995008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784186659.018776:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784186659.018779:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784186659.018781:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeb88000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784186659.018784:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:1.0:1784186659.018787:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784186659.018790:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b9ffeb88000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1784186659.018802:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffe061c00 x1870854937995136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784186659.018847:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937995264:0@lo:400:kworker.0 00000100:00100000:1.0:1784186659.018911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186659.019001:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937995264 00000100:00100000:1.0:1784186659.019008:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937995264 00000100:00100000:1.0:1784186659.019051:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784186659.019059:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937995264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186659.019124:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937995264:12345-0@lo:400:kworker.0 Request processed in 65us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186659.019131:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784186659.019206:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b9ffe062a00 x1870854937995264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186659.019218:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937995264:0@lo:400:kworker.0 00000100:00100000:3.0:1784186659.019482:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3309:1870854937994880:0@lo:400:kworker.0 00000100:00100000:3.0:1784186659.019526:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186659.019569:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937995008:0@lo:8:kworker.0 00000400:00000100:3.0:1784186659.019592:0:3305:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870854937995008 offset 0 length 520: 4 00000100:00100000:3.0:1784186659.019604:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937995136:0@lo:8:kworker.0 00000400:00000100:3.0:1784186659.019621:0:3305:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870854937995136 offset 0 length 520: 4 00000100:00100000:1.0:1784186659.019842:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937994880 00000100:00100000:1.0:1784186659.019847:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937994880 00000100:00100000:1.0:1784186659.019884:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784186659.019892:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:3309:x1870854937994880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186659.020148:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:3309:x1870854937994880:12345-0@lo:400:kworker.0 Request processed in 255us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186659.020156:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784186659.031415:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3309:1870854937994880:0@lo:400:kworker.0 10000000:01000000:1.0:1784186659.134172:0:14209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784186659.134185:0:14209:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc7fc5000 from 10 10000000:01000000:1.0:1784186659.134191:0:14209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784186659.134251:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186659.134264:0:14209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186659.134277:0:14209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186659.134306:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937995392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784186659.134383:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186659.134688:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937995392 00000100:00100000:2.0:1784186659.134697:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937995392 00000100:00100000:2.0:1784186659.134765:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784186659.134777:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+11:14209:x1870854937995392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784186659.134794:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186659.134814:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc766de00/0x55bc3e8c99d1a213 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a20c expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186659.134844:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766de00/0x55bc3e8c99d1a213 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a20c expref: 12 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186659.134855:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc766de00/0x55bc3e8c99d1a213 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a20c expref: 12 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186659.134865:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766de00, rc 0) 00000100:00100000:2.0:1784186659.134911:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14209:x1870854937995392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186659.134918:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784186659.135275:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651d240 going to sleep for 11 seconds 00000100:00100000:1.0:1784186659.135306:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937995392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784186659.135322:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186659.135354:0:14209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186659.135430:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937995520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784186659.135507:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186659.139092:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937995520 00000100:00100000:2.0:1784186659.139107:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937995520 00000100:00100000:2.0:1784186659.139159:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784186659.139170:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14209:x1870854937995520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784186659.139494:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14209:x1870854937995520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (3984us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186659.139502:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784186659.145514:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651d240 going to sleep for 11 seconds 00000100:00100000:2.0:1784186659.145568:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937995520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784186659.145635:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937995648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784186659.145728:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186659.145756:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc9219d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186659.146186:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937995648 00000100:00100000:1.0:1784186659.146195:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937995648 00000100:00100000:1.0:1784186659.146253:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784186659.146263:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14209:x1870854937995648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784186659.146496:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14209:x1870854937995648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186659.146505:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784186659.146650:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937995648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784186659.147955:0:14700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1784186659.148254:0:14209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1784186659.148278:0:14209:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784186659.148289:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186659.148302:0:14209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186659.583356:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186660.605735:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186661.633334:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784186662.016839:0:14246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1784186662.337507:0:14844:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784186662.337513:0:14844:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1784186662.337639:0:14844:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b9ec4a84800 00000020:01000004:1.0:1784186662.337660:0:14844:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1784186662.337674:0:14844:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1784186662.337691:0:14844:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9b9ec681b380) 00000020:00000080:1.0:1784186662.337710:0:14844:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1784186662.356487:0:14844:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1784186662.356875:0:14844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1784186662.357859:0:14844:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1784186662.358216:0:14844:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1784186662.358561:0:14844:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1784186662.359094:0:14844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 225: rc = 0 00100000:10000000:1.0:1784186662.359196:0:14844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 225: rc = 0 00100000:10000000:1.0:1784186662.359292:0:14844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 225: rc = 0 00100000:10000000:1.0:1784186662.360104:0:14844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 642: rc = 0 00100000:10000000:1.0:1784186662.360396:0:14844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 642: rc = 0 00100000:10000000:1.0:1784186662.360821:0:14844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:1.0:1784186662.361764:0:14844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 642: rc = 0 00100000:10000000:1.0:1784186662.362139:0:14844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:1.0:1784186662.362402:0:14844:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00000020:00000080:1.0:1784186662.363244:0:14844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1784186662.363256:0:14844:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784186662.363267:0:14844:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x55bc3e8c99d1a221 00000020:01000004:1.0:1784186662.363275:0:14844:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1784186662.363295:0:14844:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784186662.363298:0:14844:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784186662.363304:0:14844:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1784186662.363308:0:14844:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1784186662.363319:0:14844:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9b9ec6818000) 00000020:00000080:1.0:1784186662.363329:0:14844:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1784186662.364800:0:14844:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784186662.365177:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1784186662.365184:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1784186662.374905:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1784186662.374931:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1784186662.376771:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1784186662.376782:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1784186662.379810:0:14844:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784186662.380151:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1784186662.380158:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784186662.381141:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784186662.381150:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1784186662.425929:0:14844:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784186662.426416:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784186662.426423:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784186662.434389:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784186662.434408:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1784186662.436616:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784186662.436631:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1784186662.441759:0:14844:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784186662.442108:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1784186662.442116:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1784186662.444164:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1784186662.444176:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1784186662.485394:0:14844:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784186662.485677:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1784186662.485683:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1784186662.487033:0:14844:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1784186662.487045:0:14844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1784186662.487468:0:14844:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1784186662.487498:0:14844:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1784186662.487514:0:14844:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1784186662.497684:0:14844:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784186662.497733:0:14844:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.131@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1784186662.497738:0:14844:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784186662.497740:0:14844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784186662.497741:0:14844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784186662.497742:0:14844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784186662.497743:0:14844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784186662.497744:0:14844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784186662.497746:0:14844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784186662.497748:0:14844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784186662.497749:0:14844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784186662.497753:0:14844:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1784186662.497756:0:14844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784186662.497757:0:14844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784186662.497758:0:14844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784186662.497759:0:14844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784186662.497760:0:14844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784186662.497761:0:14844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784186662.497762:0:14844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784186662.497763:0:14844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784186662.497764:0:14844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784186662.497796:0:14844:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784186662.497820:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937995776:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784186662.497906:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186662.498156:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd629e780 going to sleep for 11 seconds 00000100:00100000:0.0:1784186662.498263:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937995776 00000100:00100000:0.0:1784186662.498271:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937995776 00000100:00100000:0.0:1784186662.498347:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784186662.498356:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe895850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14844:x1870854937995776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784186662.498384:0:14207:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784186662.498387:0:14207:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1784186662.498391:0:14207:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784186662.505732:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe895850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14844:x1870854937995776:12345-0@lo:253:mount.lustre.0 Request processed in 7367us (7817us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186662.505747:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784186662.505841:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937995776:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784186662.505856:0:14844:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784186662.505874:0:14844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784186662.505876:0:14844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784186662.505877:0:14844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784186662.505878:0:14844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784186662.505879:0:14844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784186662.505881:0:14844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784186662.505882:0:14844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784186662.505884:0:14844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784186662.505885:0:14844:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784186662.506138:0:14844:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b9ec4a84800 from lustre-OST0000 10000000:01000000:1.0:1784186662.506168:0:14844:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1784186662.506171:0:14844:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784186662.506178:0:14844:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b9ec681cd40 local copy 00010000:00010000:1.0:1784186662.506190:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a11e expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186662.506653:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937995904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784186662.506697:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186662.506785:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd629e180 going to sleep for 11 seconds 00000100:00100000:2.0:1784186662.506825:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937995904 00000100:00100000:2.0:1784186662.506831:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937995904 00000100:00100000:2.0:1784186662.506903:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784186662.506913:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe897c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14844:x1870854937995904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186662.507139:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe897c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14844:x1870854937995904:12345-0@lo:501:mount.lustre.0 Request processed in 226us (439us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784186662.507146:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784186662.507245:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937995904:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784186662.507262:0:14844:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1784186662.507406:0:14844:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1784186662.507427:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a11e expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.507437:0:14844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a11e expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186662.507481:0:14844:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b9ec4a84800 10000000:01000000:3.0:1784186662.507486:0:14844:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784186662.507490:0:14844:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9b9ec681cd40 10000000:01000000:3.0:1784186662.507500:0:14844:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1784186662.507725:0:14844:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9b9ec681cd40 from 1 10000000:01000000:3.0:1784186662.507729:0:14844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784186662.507757:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda504200/0x55bc3e8c99d1a22f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.507764:0:14844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fda504200/0x55bc3e8c99d1a22f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.507773:0:14844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fda504200/0x55bc3e8c99d1a22f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186662.507787:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784186662.507818:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186662.508353:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccc0c540 going to sleep for 11 seconds 00000100:00100000:1.0:1784186662.508614:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937996032 00000100:00100000:1.0:1784186662.508621:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937996032 00000100:00100000:1.0:1784186662.508657:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784186662.508665:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+12:14844:x1870854937996032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784186662.508677:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186662.508693:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc27ed200/0x55bc3e8c99d1a236 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a22f expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186662.508717:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc27ed200/0x55bc3e8c99d1a236 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a22f expref: 13 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186662.508727:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc27ed200/0x55bc3e8c99d1a236 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a22f expref: 13 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186662.508749:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc27ed200, rc 0) 00000100:00100000:1.0:1784186662.508785:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+13:14844:x1870854937996032:12345-0@lo:101:mount.lustre.0 Request processed in 122us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186662.508791:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784186662.508887:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784186662.508912:0:14844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fda504200/0x55bc3e8c99d1a22f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a236 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.509156:0:14844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fda504200/0x55bc3e8c99d1a22f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a236 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186662.509178:0:14844:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784186662.509191:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda504200/0x55bc3e8c99d1a22f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a236 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.509267:0:14844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fda504200/0x55bc3e8c99d1a22f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a236 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186662.509275:0:14844:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1784186662.509284:0:14844:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784186662.509289:0:14844:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1784186662.509291:0:14844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784186662.509310:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a23d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.509317:0:14844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a23d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.509324:0:14844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a23d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186662.509338:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784186662.509367:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186662.509433:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccc0c540 going to sleep for 11 seconds 00000100:00100000:2.0:1784186662.509603:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937996160 00000100:00100000:2.0:1784186662.509610:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937996160 00000100:00100000:0.0:1784186662.509671:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784186662.509680:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+13:14844:x1870854937996160:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784186662.509688:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186662.509696:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a23d expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.509710:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a23d expref: 14 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.509719:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ec58fac00/0x55bc3e8c99d1a244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a23d expref: 14 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.509724:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fac00, rc 0) 00000100:00100000:0.0:1784186662.509770:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+14:14844:x1870854937996160:12345-0@lo:101:mount.lustre.0 Request processed in 91us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186662.509775:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784186662.509882:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784186662.509893:0:14844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a23d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a244 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.509910:0:14844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a23d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a244 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784186662.511325:0:14844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1784186662.512891:0:14844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784186662.514699:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1784186662.514751:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1784186662.514778:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1784186662.514816:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1784186662.514846:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1784186662.514874:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1784186662.515268:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1784186662.515277:0:14844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1784186662.515386:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784186662.515744:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186662.515818:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccc0c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186662.515855:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937996288 00000100:00100000:2.0:1784186662.515862:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937996288 00000100:00100000:2.0:1784186662.516168:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784186662.516179:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe896850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+14:14844:x1870854937996288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186662.516764:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe896850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+14:14844:x1870854937996288:12345-0@lo:501:mount.lustre.0 Request processed in 586us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186662.516773:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784186662.516844:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784186662.516882:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784186662.516951:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186662.517598:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccc0c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186662.517680:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937996416 00000100:00100000:1.0:1784186662.517687:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937996416 00000100:00100000:1.0:1784186662.517716:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784186662.517723:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe896c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+14:14844:x1870854937996416:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784186662.518328:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe896c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+14:14844:x1870854937996416:12345-0@lo:503:mount.lustre.0 Request processed in 603us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186662.518336:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784186662.518430:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784186662.519706:0:14844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784186662.519804:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784186662.519860:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186662.519885:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9feb245840 going to sleep for 11 seconds 00000100:00100000:1.0:1784186662.520165:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937996544 00000100:00100000:1.0:1784186662.520173:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937996544 00000100:00100000:1.0:1784186662.520271:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784186662.520280:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+14:14844:x1870854937996544:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784186662.520795:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+14:14844:x1870854937996544:12345-0@lo:502:mount.lustre.0 Request processed in 514us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186662.520802:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784186662.521146:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784186662.521611:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1784186662.521673:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1784186662.521701:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1784186662.521743:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1784186662.521772:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1784186662.521800:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1784186662.521840:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1784186662.521870:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1784186662.521910:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1784186662.522266:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1784186662.522313:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1784186662.522355:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1784186662.522406:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784186662.522689:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186662.522725:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fccc0c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186662.522797:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937996672 00000100:00100000:1.0:1784186662.522804:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937996672 00000100:00100000:1.0:1784186662.522850:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784186662.522858:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+14:14844:x1870854937996672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784186662.523276:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+14:14844:x1870854937996672:12345-0@lo:502:mount.lustre.0 Request processed in 416us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186662.523284:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784186662.523638:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784186662.523726:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1784186662.523737:0:14844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1784186662.525706:0:14858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784186662.525716:0:14858:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1784186662.525722:0:14858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186662.525724:0:14858:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1784186662.525732:0:14858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784186662.525746:0:14858:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9b9fc9273380) 00000020:00000080:0.0:1784186662.525769:0:14858:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1784186662.525776:0:14858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784186662.525852:0:14858:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b9ec4a84800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1784186662.525858:0:14858:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784186662.525865:0:14858:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x55bc3e8c99d1a252 00010000:00010000:0.0:1784186662.533388:0:14858:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1784186662.534315:0:14858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1784186662.537672:0:14858:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1784186662.539338:0:14858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1784186662.539352:0:14858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186662.539358:0:14858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186662.539361:0:14858:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1784186662.539364:0:14858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784186662.539367:0:14858:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1784186662.539369:0:14858:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784186662.539370:0:14858:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784186662.539371:0:14858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784186662.539373:0:14858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186662.539374:0:14858:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784186662.539376:0:14858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186662.539379:0:14858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186662.539380:0:14858:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784186662.539382:0:14858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784186662.539383:0:14858:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784186662.539395:0:14858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186662.539397:0:14858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186662.539399:0:14858:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784186662.539401:0:14858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784186662.539404:0:14858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186662.539405:0:14858:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784186662.539419:0:14858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784186662.539786:0:14858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784186662.539792:0:14858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784186662.539793:0:14858:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784186662.539797:0:14858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1784186662.542909:0:14844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1784186662.543150:0:14844:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784186662.543231:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a23d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a244 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.543245:0:14844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fda505e00/0x55bc3e8c99d1a23d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a244 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186662.543278:0:14844:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9ec4a84800 from 1 10000000:01000000:3.0:1784186662.543282:0:14844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784186662.543319:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.543327:0:14844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.543338:0:14844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186662.543365:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784186662.543472:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186662.543725:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937996800 00000100:00100000:2.0:1784186662.543732:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937996800 00000100:00100000:2.0:1784186662.548934:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784186662.548961:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+14:14844:x1870854937996800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784186662.548989:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186662.549009:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc766c400/0x55bc3e8c99d1a260 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a259 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186662.549049:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766c400/0x55bc3e8c99d1a260 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a259 expref: 15 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186662.549062:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc766c400/0x55bc3e8c99d1a260 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a259 expref: 15 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186662.549070:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c400, rc 0) 00000100:00100000:2.0:1784186662.549141:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14844:x1870854937996800:12345-0@lo:101:mount.lustre.0 Request processed in 188us (5669us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186662.549148:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784186662.549339:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186662.549366:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784186662.549389:0:14844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.549396:0:14844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784186662.549986:0:14844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1784186662.550647:0:14844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784186662.550827:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1784186662.550854:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1784186662.550888:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1784186662.550894:0:14844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1784186662.551312:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784186662.551368:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186662.551405:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186662.551691:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937996928 00000100:00100000:2.0:1784186662.551698:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937996928 00000100:00100000:2.0:1784186662.551746:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784186662.551752:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe896050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14844:x1870854937996928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186662.551971:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe896050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14844:x1870854937996928:12345-0@lo:501:mount.lustre.0 Request processed in 218us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186662.551990:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784186662.552326:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937996928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784186662.552359:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784186662.552394:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186662.553346:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186662.553667:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937997056 00000100:00100000:1.0:1784186662.553673:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937997056 00000100:00100000:1.0:1784186662.553719:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784186662.553726:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14844:x1870854937997056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784186662.553905:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14844:x1870854937997056:12345-0@lo:503:mount.lustre.0 Request processed in 180us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186662.553911:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784186662.554201:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997056:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784186662.554775:0:14844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784186662.554844:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997184:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784186662.554887:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186662.554912:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784186662.555320:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937997184 00000100:00100000:1.0:1784186662.555327:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937997184 00000100:00100000:1.0:1784186662.555359:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784186662.555367:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14844:x1870854937997184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784186662.555733:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14844:x1870854937997184:12345-0@lo:502:mount.lustre.0 Request processed in 365us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186662.555741:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784186662.555830:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784186662.556884:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1784186662.556959:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1784186662.557303:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1784186662.557347:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1784186662.557404:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1784186662.557702:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1784186662.557744:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1784186662.557782:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1784186662.558279:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784186662.558361:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186662.558670:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd629e900 going to sleep for 11 seconds 00000100:00100000:0.0:1784186662.558758:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937997312 00000100:00100000:0.0:1784186662.558766:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937997312 00000100:00100000:0.0:1784186662.558930:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784186662.558950:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe897850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14844:x1870854937997312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784186662.559649:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe897850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14844:x1870854937997312:12345-0@lo:502:mount.lustre.0 Request processed in 699us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186662.559659:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784186662.560131:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997312:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784186662.560362:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1784186662.560387:0:14844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1784186662.566731:0:14862:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784186662.566743:0:14862:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186662.566746:0:14862:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784186662.566753:0:14862:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9ec4a84800 00000020:00000080:3.0:1784186662.566755:0:14862:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784186662.566763:0:14862:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186662.566766:0:14862:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186662.566767:0:14862:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784186662.566769:0:14862:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784186662.566771:0:14862:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186662.566772:0:14862:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784186662.566776:0:14862:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9ec4a84800 00000020:00000080:3.0:1784186662.566778:0:14862:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784186662.566836:0:14862:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186662.566840:0:14862:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186662.566841:0:14862:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784186662.566844:0:14862:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784186662.566846:0:14862:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186662.566847:0:14862:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784186662.566850:0:14862:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b9ec4a84800 00000020:00000080:3.0:1784186662.566852:0:14862:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784186662.566885:0:14862:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186662.566889:0:14862:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186662.566890:0:14862:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784186662.566893:0:14862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1784186662.575173:0:14844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1784186662.575231:0:14844:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784186662.575247:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186662.575260:0:14844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186662.575314:0:14844:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784186662.575318:0:14844:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b9ec4a84800 10000000:01000000:2.0:1784186662.575321:0:14844:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b9ec4a84800 10000000:01000000:2.0:1784186662.575325:0:14844:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784186662.575332:0:14844:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9ec4a84800 from 1 10000000:01000000:2.0:1784186662.575335:0:14844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784186662.575373:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c800/0x55bc3e8c99d1a267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186662.575382:0:14844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c800/0x55bc3e8c99d1a267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186662.575394:0:14844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c800/0x55bc3e8c99d1a267 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186662.575434:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997440:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784186662.575548:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186662.575600:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937997440 00000100:00100000:2.0:1784186662.575608:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937997440 00000100:00100000:2.0:1784186662.575651:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784186662.575660:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14844:x1870854937997440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784186662.575674:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186662.575687:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc766ca00/0x55bc3e8c99d1a26e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a267 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186662.575712:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766ca00/0x55bc3e8c99d1a26e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a267 expref: 16 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186662.575723:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc766ca00/0x55bc3e8c99d1a26e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a267 expref: 16 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186662.575733:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766ca00, rc 0) 00000100:00100000:2.0:1784186662.575769:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14844:x1870854937997440:12345-0@lo:101:mount.lustre.0 Request processed in 110us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186662.575776:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784186662.575822:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe54169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186662.575845:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784186662.575858:0:14844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c800/0x55bc3e8c99d1a267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a26e expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186662.575868:0:14844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c800/0x55bc3e8c99d1a267 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a26e expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784186662.579763:0:14844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1784186662.584405:0:14844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784186662.587828:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1784186662.589301:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1784186662.589389:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1784186662.589671:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1784186662.589712:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1784186662.589762:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1784186662.589799:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1784186662.589831:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1784186662.589914:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1784186662.589964:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1784186662.589998:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1784186662.592799:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1784186662.592867:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1784186662.592905:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1784186662.593164:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1784186662.593216:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1784186662.593254:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1784186662.593302:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1784186662.593338:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1784186662.593371:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1784186662.593420:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1784186662.593489:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1784186662.593525:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1784186662.593596:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1784186662.593634:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1784186662.593668:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1784186662.593720:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1784186662.593754:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1784186662.593839:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1784186662.593846:0:14844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1784186662.593982:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186662.594594:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186662.594653:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937997568 00000100:00100000:2.0:1784186662.594662:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937997568 00000100:00100000:2.0:1784186662.594708:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784186662.594716:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14844:x1870854937997568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186662.594992:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14844:x1870854937997568:12345-0@lo:501:mount.lustre.0 Request processed in 275us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186662.595000:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784186662.596360:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe54169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186662.596400:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186662.596482:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784186662.596546:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186662.596573:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe54169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784186662.596653:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937997696 00000100:00100000:0.0:1784186662.596659:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937997696 00000100:00100000:0.0:1784186662.596709:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784186662.596719:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14844:x1870854937997696:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784186662.596892:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14844:x1870854937997696:12345-0@lo:503:mount.lustre.0 Request processed in 174us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186662.596900:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784186662.597106:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997696:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784186662.597884:0:14844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784186662.598671:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784186662.598761:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186662.598800:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe54169c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186662.598865:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937997824 00000100:00100000:3.0:1784186662.598871:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937997824 00000100:00100000:3.0:1784186662.598925:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784186662.598941:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14844:x1870854937997824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784186662.599395:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14844:x1870854937997824:12345-0@lo:502:mount.lustre.0 Request processed in 462us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186662.599415:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784186662.599598:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784186662.599893:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1784186662.600424:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1784186662.600487:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1784186662.600534:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1784186662.600565:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1784186662.600604:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1784186662.600632:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1784186662.600684:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1784186662.600723:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1784186662.600750:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1784186662.600776:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1784186662.600811:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1784186662.600838:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1784186662.600864:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1784186662.600924:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1784186662.600974:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1784186662.601010:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1784186662.601058:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1784186662.601094:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1784186662.601129:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1784186662.601177:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1784186662.603495:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1784186662.603552:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1784186662.603652:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1784186662.603691:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1784186662.603724:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1784186662.603774:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1784186662.603812:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1784186662.603841:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1784186662.603884:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1784186662.608270:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1784186662.608358:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1784186662.608393:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1784186662.608485:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1784186662.608525:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1784186662.608580:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1784186662.608618:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1784186662.608651:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1784186662.608702:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1784186662.608762:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1784186662.608820:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784186662.608891:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186662.608966:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937997952 00000100:00100000:2.0:1784186662.608973:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937997952 00000100:00100000:2.0:1784186662.609031:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784186662.609040:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14844:x1870854937997952:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784186662.609238:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14844:x1870854937997952:12345-0@lo:502:mount.lustre.0 Request processed in 199us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186662.609244:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784186662.609287:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe54169c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186662.609306:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937997952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784186662.609355:0:14844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1784186662.609361:0:14844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1784186662.615151:0:14868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784186662.615170:0:14868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9b9fc92e0000) 00000020:00000080:1.0:1784186662.615306:0:14868:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1784186662.615727:0:14868:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b9ec4a84800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784186662.615732:0:14868:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b9ec4a84800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784186662.615734:0:14868:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9ec4a84800 3 00010000:00080000:1.0:1784186662.615768:0:14868:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b9fd4f67000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.131@tcp at head 00010000:00010000:1.0:1784186662.618323:0:14868:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1784186662.618483:0:14868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1784186662.618520:0:14868:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784186662.618533:0:14868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x55bc3e8c99d1a27c 00000100:00080000:1.0:1784186662.618544:0:14868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784186662.618550:0:14868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9b9fd4f67000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1784186662.618586:0:14868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffe061500 x1870854937998080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784186662.618632:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1870854937998080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784186662.618704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186662.618770:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937998080 00000100:00100000:1.0:1784186662.618777:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937998080 00000100:00100000:1.0:1784186662.618807:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784186662.618813:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1870854937998080:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1784186662.618834:0:14212:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1784186662.618865:0:14212:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x55bc3e8c99d1a283 00000004:00100000:1.0:1784186662.618880:0:14212:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784186662.618909:0:14212:0:(import.c:65:import_set_state_nolock()) ffff9b9ec5bda000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784186662.618984:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1870854937998080:12345-0@lo:38:llog_process_th.0 Request processed in 168us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186662.618992:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1784186662.619032:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b9ffe061500 x1870854937998080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784186672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186662.619050:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784186662.619059:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1784186662.619068:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784186662.619073:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784186662.619075:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fd4f67000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784186662.619082:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1870854937998080:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1784186662.619104:0:14868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784186662.619135:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784186662.619141:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784186662.619144:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784186662.619147:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784186662.619187:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937998208:0@lo:400:kworker.0 00000100:00100000:1.0:1784186662.619214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186662.619250:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937998208 00000100:00100000:1.0:1784186662.619253:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937998208 00000100:00100000:1.0:1784186662.619293:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784186662.619300:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937998208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186662.619339:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1870854937998208:12345-0@lo:400:kworker.0 Request processed in 40us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186662.619346:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784186662.619373:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9b9ffe061500 x1870854937998208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186662.619383:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1870854937998208:0@lo:400:kworker.0 00000040:00080000:1.0:1784186662.620724:0:14868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1784186662.621632:0:14844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1784186662.621661:0:14844:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784186662.621677:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c800/0x55bc3e8c99d1a267 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a26e expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.621688:0:14844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc766c800/0x55bc3e8c99d1a267 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a26e expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784186662.621729:0:14844:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784186662.621731:0:14844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784186662.621732:0:14844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784186662.621732:0:14844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784186662.621733:0:14844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784186662.621734:0:14844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784186662.621735:0:14844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784186662.621736:0:14844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784186662.621737:0:14844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784186662.621741:0:14844:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1784186662.621743:0:14844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784186662.621744:0:14844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784186662.621744:0:14844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784186662.621745:0:14844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784186662.621746:0:14844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784186662.621746:0:14844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784186662.621747:0:14844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784186662.621747:0:14844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784186662.621748:0:14844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784186662.621767:0:14844:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1784186662.621783:0:14844:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937998336:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784186662.621835:0:14844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186662.621869:0:14844:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f840 going to sleep for 11 seconds 00000100:00100000:1.0:1784186662.627101:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937998336 00000100:00100000:1.0:1784186662.627116:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937998336 00000100:00100000:1.0:1784186662.627357:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784186662.627370:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14844:x1870854937998336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784186662.627408:0:14207:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784186662.627423:0:14207:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1784186662.653641:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1784186662.656604:0:14207:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784186662.656661:0:14207:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1784186662.660727:0:14228:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784186662.660748:0:14228:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784186662.660765:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.660779:0:14228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a1f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a1f0 expref: 16 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.660785:0:14228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.660819:0:14228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a1f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d1a1f0 expref: 16 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.660829:0:14228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a1f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1f0 expref: 16 pid: 14205 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186662.660840:0:14228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14228:1870854937998464:0@lo:104: 00000100:00100000:3.0:1784186662.660899:0:14228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186662.661041:0:14196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937998464 00000100:00100000:0.0:1784186662.661049:0:14196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937998464 00000100:00100000:0.0:1784186662.661096:0:14196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784186662.661105:0:14196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+3:14228:x1870854937998464:12345-0@lo:104: 00010000:00010000:0.0:1784186662.661126:0:14196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661177:0:14196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784186662.661183:0:14196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+3:14228:x1870854937998464:12345-0@lo:104: Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186662.661289:0:14196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1784186662.661314:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186662.661319:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661325:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed600 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186662.661327:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661334:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186662.661339:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186662.661342:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186662.661365:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661369:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186662.661386:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661391:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ed600/0x55bc3e8c99d1a1f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a1f7 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661410:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186662.661412:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186662.661414:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186662.661437:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854937998592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784186662.661498:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186662.661564:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937998592 00000100:00100000:0.0:1784186662.661568:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937998592 00010000:00010000:0.0:1784186662.661587:0:14199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a1f7 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1f0 expref: 17 pid: 14205 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186662.661605:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784186662.661610:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:3308:x1870854937998592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784186662.661618:0:14199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186662.661622:0:14199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a1f7 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1f0 expref: 17 pid: 14205 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661629:0:14199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a1f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1f0 expref: 17 pid: 14205 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661642:0:14199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661648:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784186662.661658:0:14199:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000911772s 00010000:00010000:0.0:1784186662.661661:0:14199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661673:0:14199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661678:0:14199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661682:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661685:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504c00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186662.661688:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661692:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661697:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186662.661704:0:14199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784186662.661724:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:3308:x1870854937998592:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186662.661728:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784186662.661754:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854937998592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784186662.661820:0:14228:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f600 going to sleep for 11 seconds 00010000:00010000:3.0:1784186662.661829:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a1f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d1a1f0 expref: 16 pid: 14205 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186662.661836:0:14228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14228:1870854937998464:0@lo:104: 00010000:00010000:3.0:1784186662.661845:0:14228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.661850:0:14228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.661854:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186662.661866:0:14228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda504c00/0x55bc3e8c99d1a28a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186662.664473:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14844:x1870854937998336:12345-0@lo:253:mount.lustre.0 Request processed in 37071us (42600us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186662.664489:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784186662.664623:0:14844:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14844:1870854937998336:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784186662.664641:0:14844:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784186662.664645:0:14844:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784186662.664647:0:14844:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784186662.664648:0:14844:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784186662.664649:0:14844:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784186662.664650:0:14844:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784186662.664651:0:14844:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784186662.664653:0:14844:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784186662.664655:0:14844:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784186662.664656:0:14844:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784186662.664673:0:14844:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784186662.668821:0:14844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784186662.669116:0:14844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784186662.669315:0:14844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784186662.669577:0:14844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784186662.669751:0:14844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784186662.670124:0:14844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784186662.671091:0:14844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1784186662.725546:0:14844:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784186662.725556:0:14844:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1784186662.725593:0:14844:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784186662.725650:0:14844:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784186662.725668:0:14844:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1784186662.725709:0:14844:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1784186663.678028:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784186664.259093:0:14209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784186664.259101:0:14209:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b9fc7fc5000 from 7 10000000:01000000:1.0:1784186664.259107:0:14209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784186664.259154:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186664.259167:0:14209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186664.259179:0:14209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186664.259205:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937998720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784186664.259282:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186664.259336:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1dbee40 going to sleep for 11 seconds 00000100:00100000:2.0:1784186664.259596:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937998720 00000100:00100000:2.0:1784186664.259607:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937998720 00000100:00100000:2.0:1784186664.259731:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784186664.259740:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+15:14209:x1870854937998720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784186664.259753:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186664.259767:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc766d800/0x55bc3e8c99d1a298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a291 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186664.260434:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766d800/0x55bc3e8c99d1a298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a291 expref: 16 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186664.260470:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc766d800/0x55bc3e8c99d1a298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a291 expref: 16 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186664.261574:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d800, rc 0) 00000100:00100000:2.0:1784186664.261643:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14209:x1870854937998720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1903us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186664.261652:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784186664.261710:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937998720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784186664.261730:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186664.261741:0:14209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186664.261800:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937998848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784186664.261834:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186664.261865:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58480 going to sleep for 11 seconds 00000100:00100000:0.0:1784186664.262134:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937998848 00000100:00100000:0.0:1784186664.262140:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937998848 00000100:00100000:0.0:1784186664.262197:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784186664.262205:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14209:x1870854937998848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784186664.262221:0:14207:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784186664.262236:0:14207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784186664.262238:0:14207:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1784186664.262303:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14209:x1870854937998848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186664.262310:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784186664.263619:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854937998848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784186664.263687:0:14209:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784186664.263696:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186664.263707:0:14209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186664.715113:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186665.725755:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186666.750647:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784186667.709673:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784186667.709681:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784186667.709691:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784186667.709694:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784186667.709744:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784186667.709765:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854937998976:0@lo:400:kworker.0 00000100:00100000:1.0:1784186667.709841:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186667.709909:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937999104:0@lo:400:kworker.0 00000100:00100000:1.0:1784186667.709939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186667.709958:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186667.709964:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937999232:0@lo:400:kworker.0 00000100:00100000:1.0:1784186667.709987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186667.710020:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937998976 00000100:00100000:1.0:1784186667.710028:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937998976 00000100:00100000:1.0:1784186667.710079:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784186667.710090:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:3308:x1870854937998976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186667.710141:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:3308:x1870854937998976:12345-0@lo:400:kworker.0 Request processed in 53us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186667.710149:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784186667.710187:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937999104 00000100:00100000:1.0:1784186667.710191:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937999104 00000100:00100000:1.0:1784186667.710215:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937999232 00000100:00100000:1.0:1784186667.710218:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937999232 00000100:00100000:1.0:1784186667.710241:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784186667.710247:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937999104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186667.710281:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854937999104:12345-0@lo:400:kworker.0 Request processed in 34us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186667.710288:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784186667.710312:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784186667.710317:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937999232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186667.710346:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe063100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937999232:12345-0@lo:400:kworker.0 Request processed in 29us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186667.710352:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1784186667.710396:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffe062680 x1870854937999232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186667.710410:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937999232:0@lo:400:kworker.0 00010000:00080000:1.0:1784186667.710421:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffe063480 x1870854937999104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186667.710428:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854937999104:0@lo:400:kworker.0 00000100:00100000:1.0:1784186667.710478:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854937998976:0@lo:400:kworker.0 00000100:00080000:3.0:1784186667.710671:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784186667.776740:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186668.798696:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784186669.316293:0:15211:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784186669.822672:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186670.847159:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186671.869731:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784186672.259588:0:14246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1784186672.831209:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784186672.831217:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784186672.831220:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784186672.831223:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784186672.831293:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854937999360:0@lo:400:kworker.0 00000100:00100000:3.0:1784186672.831376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186672.831425:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784186672.831459:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937999488:0@lo:400:kworker.0 00000100:00100000:3.0:1784186672.831491:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186672.831519:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937999616:0@lo:400:kworker.0 00000100:00100000:3.0:1784186672.831541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186672.831572:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937999360 00000100:00100000:3.0:1784186672.831579:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937999360 00000100:00100000:3.0:1784186672.831623:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784186672.831633:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:3308:x1870854937999360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186672.831682:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:3308:x1870854937999360:12345-0@lo:400:kworker.0 Request processed in 51us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186672.831689:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784186672.831717:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937999488 00000100:00100000:3.0:1784186672.831721:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937999488 00000100:00100000:3.0:1784186672.831741:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937999616 00000100:00100000:3.0:1784186672.831757:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937999616 00000100:00100000:3.0:1784186672.831788:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784186672.831793:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937999488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186672.831821:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854937999488:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186672.831826:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784186672.831836:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186672.831841:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937999616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186672.831877:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1870854937999616:12345-0@lo:400:kworker.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186672.831882:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1784186672.831903:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784186672.831926:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffeeb7480 x1870854937999616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186672.831947:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854937999616:0@lo:400:kworker.0 00010000:00080000:3.0:1784186672.831974:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffeeb7b80 x1870854937999488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186672.831983:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854937999488:0@lo:400:kworker.0 00000100:00100000:3.0:1784186672.831991:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854937999360:0@lo:400:kworker.0 00010000:00010000:2.0:1784186672.893550:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186673.920050:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186674.881108:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784186659/real 1784186659] req@ffff9b9ffe063800 x1870854937995008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784186674 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186674.881143:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b9ffe063800 x1870854937995008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784186674 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186674.881153:0:3305:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784186659/real 1784186659] req@ffff9b9ffe061c00 x1870854937995136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784186674 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186674.881164:0:3305:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9b9ffe061c00 x1870854937995136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784186674 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784186674.881183:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fc4aa0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784186674.881211:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784186674.881216:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937995008:0@lo:8:kworker.0 00000100:00080000:0.0:1784186674.881221:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeb88000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784186674.881234:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1784186674.881237:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937995136:0@lo:8:kworker.0 00000100:00080000:1.0:1784186674.881611:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784186674.881615:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784186674.881618:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b9fc4aa0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784186674.881623:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:1.0:1784186674.881627:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784186674.881633:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9b9fc4aa0800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1784186674.881650:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffe063480 x1870854937999872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784186674.881664:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784186674.881667:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784186674.881674:0:8:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeb88000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784186674.881677:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:1.0:1784186674.881680:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784186674.881684:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b9ffeb88000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:1.0:1784186674.881695:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffe062680 x1870854938000000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784186674.881764:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3307:1870854937999744:0@lo:400:kworker.0 00000100:00100000:0.0:1784186674.882570:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937999872:0@lo:8:kworker.0 00000100:00100000:1.0:1784186674.882828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186674.884690:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186674.884781:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854938000000:0@lo:8:kworker.0 00000100:00100000:0.0:1784186674.884930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186674.885070:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937999872 00000100:00100000:2.0:1784186674.885083:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937999872 00000100:00100000:2.0:1784186674.885126:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938000000 00000100:00100000:2.0:1784186674.885129:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938000000 00000100:00100000:2.0:1784186674.885144:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784186674.885153:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1870854937999872:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1784186674.885187:0:14845:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:2.0:1784186674.885225:0:14845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x55bc3e8c99d1a29f 00002000:00100000:2.0:1784186674.885239:0:14845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9b9fd18f2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784186674.885244:0:14845:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784186674.885246:0:14845:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784186674.886578:0:14845:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784186674.886618:0:14845:0:(import.c:65:import_set_state_nolock()) ffff9b9fd18f5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784186674.886694:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1870854937999872:12345-0@lo:8:kworker.0 Request processed in 1539us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186674.886703:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784186674.886891:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffe063480 x1870854937999872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784186694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784186674.886904:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784186674.886914:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784186674.886923:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784186674.886929:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784186674.886932:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9fc4aa0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784186674.886954:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784186674.886960:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854937999872:0@lo:8:kworker.0 00000004:00080000:0.0:1784186674.887014:0:14235:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1784186674.887028:0:14235:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14235:1870854938000512:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784186674.887054:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186674.887071:0:14235:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f540 going to sleep for 11 seconds 00000100:00100000:0.0:1784186674.887088:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938000512 00000100:00100000:0.0:1784186674.887091:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938000512 00000100:00100000:0.0:1784186674.887129:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784186674.887135:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1870854938000000:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1784186674.887151:0:14848:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784186674.887185:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1870854938000000:12345-0@lo:8:kworker.0 Request processed in 49us (2255us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784186674.887200:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784186674.887214:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784186674.887221:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14235:x1870854938000512:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784186674.887695:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784186674.887704:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938000384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186674.887882:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186674.887923:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854938000128:0@lo:400:kworker.0 00000100:00100000:1.0:1784186674.887951:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186674.887974:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784186674.887980:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854938000256:0@lo:400:kworker.0 00000100:00100000:1.0:1784186674.888002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186674.888033:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854937999744 00000100:00100000:1.0:1784186674.888038:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854937999744 00000100:00100000:1.0:1784186674.888071:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784186674.888078:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:3307:x1870854937999744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186674.888119:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:3307:x1870854937999744:12345-0@lo:400:kworker.0 Request processed in 41us (5291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186674.888125:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784186674.888155:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938000128 00000100:00100000:1.0:1784186674.888159:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938000128 00000100:00100000:1.0:1784186674.888183:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938000256 00000100:00100000:1.0:1784186674.888194:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938000256 00000100:00100000:1.0:1784186674.888215:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784186674.888220:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854938000128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186674.888255:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854938000128:12345-0@lo:400:kworker.0 Request processed in 35us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186674.888262:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784186674.888276:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784186674.888281:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854938000256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186674.888307:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854938000256:12345-0@lo:400:kworker.0 Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186674.888313:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1784186674.888351:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffe062300 x1870854938000256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186674.888362:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854938000256:0@lo:400:kworker.0 00010000:00080000:1.0:1784186674.888371:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffe063b80 x1870854938000128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784186674.888379:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854938000128:0@lo:400:kworker.0 00000100:00100000:1.0:1784186674.888404:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3307:1870854937999744:0@lo:400:kworker.0 00000004:00080000:3.0:1784186674.888913:0:14234:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784186674.889309:0:14234:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 453610866644ns, next at 0ns, rc = 0 00000100:00100000:2.0:1784186674.889904:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938000384 00000100:00100000:2.0:1784186674.889914:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938000384 00000100:00100000:2.0:1784186674.889967:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784186674.889977:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1870854938000384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784186674.890007:0:14849:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186674.890078:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1870854938000384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186674.890085:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784186674.890138:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffd9dea00 x1870854938000384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186674.890159:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938000384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784186674.891905:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784186674.891913:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784186674.892646:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeb88000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784186674.892656:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784186674.892661:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854938000000:0@lo:8:kworker.0 00002000:00080000:0.0:1784186674.903164:0:14848:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1784186674.903175:0:14848:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1784186674.903182:0:14848:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1784186674.922079:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.922091:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a2a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.922109:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.922114:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.922121:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a2a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.922139:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a2a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.922149:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a2a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.922158:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a2a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.922853:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784186674.927665:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.927686:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a2ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.927705:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.927710:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.927717:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a2ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.927742:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a2ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.927753:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a2ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.927760:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a2ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.932349:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784186674.932361:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a2a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.932376:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186674.932381:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a2a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.932391:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a2a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.932416:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a2a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.932425:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a2a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.932463:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186674.932467:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a2ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.932484:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186674.932500:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a2ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.932508:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a2ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.932519:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a2ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.932526:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186674.932528:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186674.932530:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.935623:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784186674.935638:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a2ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.937589:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784186674.938169:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.938179:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a2b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.938196:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.938207:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.938214:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a2b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.938231:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a2b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.938242:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a2b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.938249:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a2b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.938273:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784186674.938847:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186674.938855:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a2b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.938865:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fbe00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186674.938869:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a2b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.938880:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a2b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.938897:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a2b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.938905:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a2b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.938933:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186674.938935:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186674.938937:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784186674.941237:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.941249:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a2bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.941265:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.941269:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.941276:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a2bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.941290:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a2bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.941300:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a2bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.941315:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a2bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.941333:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784186674.941344:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186674.941349:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a2bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.941357:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fae00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.941361:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a2bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.941370:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a2bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.941386:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a2bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.941395:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a2bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.941414:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.941416:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.941418:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186674.942616:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784186674.944628:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1784186674.945738:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.945758:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a2c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.945775:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.945780:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.945786:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a2c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.945800:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a2c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.945812:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a2c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.945820:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a2c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.945836:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784186674.946308:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.946314:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a2c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946322:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.946325:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.946329:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a2c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946338:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a2c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946352:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a2c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946360:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a2c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946380:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1784186674.946396:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784186674.946402:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a2c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946409:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.946414:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a2c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946422:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a2c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946438:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a2c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946470:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a2c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946488:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186674.946497:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a2c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946503:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.946506:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a2c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946514:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a2c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946524:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a2c9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946532:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a2c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.946544:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.946546:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.946547:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.946908:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784186674.948835:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.948846:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d1a2d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.948861:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.948865:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.948870:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d1a2d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.948893:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d1a2d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.948903:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d1a2d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.948909:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d1a2d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.948927:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784186674.949349:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.949355:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372bde59/0x55bc3e8c99d1a2d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.949364:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.949366:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.949370:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000372bde59/0x55bc3e8c99d1a2d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.949378:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000372bde59/0x55bc3e8c99d1a2d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.949385:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000372bde59/0x55bc3e8c99d1a2d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.949402:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000372bde59/0x55bc3e8c99d1a2d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.949423:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784186674.949621:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784186674.949630:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d1a2d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.949644:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186674.949649:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d1a2d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.949658:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d1a2d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.949678:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d1a2d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.949686:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010096196/0x55bc3e8c99d1a2d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.949707:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186674.949711:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000372bde59/0x55bc3e8c99d1a2d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.949717:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186674.949720:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000372bde59/0x55bc3e8c99d1a2d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.949728:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000372bde59/0x55bc3e8c99d1a2d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.949770:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000372bde59/0x55bc3e8c99d1a2d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.949783:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000372bde59/0x55bc3e8c99d1a2d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.949797:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.949799:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.949800:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.950630:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784186674.951269:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.951278:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eeccba6/0x55bc3e8c99d1a2de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.951293:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.951297:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.951304:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009eeccba6/0x55bc3e8c99d1a2de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.951315:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009eeccba6/0x55bc3e8c99d1a2de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.951324:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009eeccba6/0x55bc3e8c99d1a2de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.951331:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009eeccba6/0x55bc3e8c99d1a2de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.951352:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784186674.951592:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186674.951599:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009eeccba6/0x55bc3e8c99d1a2de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.951607:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb800 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186674.951611:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009eeccba6/0x55bc3e8c99d1a2de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.951619:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009eeccba6/0x55bc3e8c99d1a2de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.951635:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009eeccba6/0x55bc3e8c99d1a2de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.951642:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009eeccba6/0x55bc3e8c99d1a2de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.951660:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.951661:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.951663:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784186674.953176:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.953187:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006953284d/0x55bc3e8c99d1a2e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.953202:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.953205:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.953211:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006953284d/0x55bc3e8c99d1a2e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.953223:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006953284d/0x55bc3e8c99d1a2e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.953231:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006953284d/0x55bc3e8c99d1a2e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.953240:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006953284d/0x55bc3e8c99d1a2e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.953262:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784186674.953994:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186674.954009:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006953284d/0x55bc3e8c99d1a2e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.954019:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.954024:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006953284d/0x55bc3e8c99d1a2e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.954034:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006953284d/0x55bc3e8c99d1a2e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.954051:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006953284d/0x55bc3e8c99d1a2e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.954058:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006953284d/0x55bc3e8c99d1a2e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.954073:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.954074:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.954076:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784186674.954752:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.954760:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e96dc9b1/0x55bc3e8c99d1a2ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.954771:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.954774:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.954779:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e96dc9b1/0x55bc3e8c99d1a2ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.954799:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e96dc9b1/0x55bc3e8c99d1a2ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.955544:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e96dc9b1/0x55bc3e8c99d1a2ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.955558:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e96dc9b1/0x55bc3e8c99d1a2ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.955578:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784186674.955914:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186674.955921:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e96dc9b1/0x55bc3e8c99d1a2ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.955929:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27eda00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.955932:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e96dc9b1/0x55bc3e8c99d1a2ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.955952:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e96dc9b1/0x55bc3e8c99d1a2ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.956183:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e96dc9b1/0x55bc3e8c99d1a2ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.956192:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e96dc9b1/0x55bc3e8c99d1a2ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.956211:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.956213:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.956215:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784186674.957668:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.957680:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab6d024b/0x55bc3e8c99d1a2f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.957695:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.957700:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.957706:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab6d024b/0x55bc3e8c99d1a2f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.957720:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab6d024b/0x55bc3e8c99d1a2f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.957740:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab6d024b/0x55bc3e8c99d1a2f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.957764:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab6d024b/0x55bc3e8c99d1a2f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.957784:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784186674.958292:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.958299:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005faa342f/0x55bc3e8c99d1a2fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.958307:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.958311:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.958315:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005faa342f/0x55bc3e8c99d1a2fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.958323:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005faa342f/0x55bc3e8c99d1a2fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.958330:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005faa342f/0x55bc3e8c99d1a2fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.958337:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005faa342f/0x55bc3e8c99d1a2fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784186674.960429:0:15513:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784186674.960433:0:15513:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1784186674.960609:0:15513:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9b9fc8258800 00000020:01000004:3.0:1784186674.960625:0:15513:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784186674.960640:0:15513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1784186674.960654:0:15513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9b9fd1853380) 00000020:00000080:3.0:1784186674.960671:0:15513:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1784186674.961794:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784186674.962378:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.962389:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d1a308 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.962414:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.962419:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.962427:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d1a308 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.962465:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d1a308 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.962477:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d1a308 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.962484:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d1a308 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964639:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784186674.964651:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab6d024b/0x55bc3e8c99d1a2f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964666:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.964671:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab6d024b/0x55bc3e8c99d1a2f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964682:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab6d024b/0x55bc3e8c99d1a2f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964704:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab6d024b/0x55bc3e8c99d1a2f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964738:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab6d024b/0x55bc3e8c99d1a2f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964761:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784186674.964765:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005faa342f/0x55bc3e8c99d1a2fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964772:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.964775:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005faa342f/0x55bc3e8c99d1a2fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964782:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005faa342f/0x55bc3e8c99d1a2fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964793:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005faa342f/0x55bc3e8c99d1a2fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964800:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005faa342f/0x55bc3e8c99d1a2fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964823:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186674.964827:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d1a308 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964833:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ede00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.964843:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d1a308 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964850:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d1a308 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964859:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d1a308 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.964866:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.964868:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.964870:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.966954:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784186674.966971:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ed6c52b/0x55bc3e8c99d1a308 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784186674.967625:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.967633:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d1a30f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.967646:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.967650:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.967657:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d1a30f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.967684:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d1a30f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.967694:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d1a30f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.967702:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d1a30f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.967712:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784186674.968114:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.968119:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a316 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.968128:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.968131:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.968135:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a316 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.968144:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a316 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.968152:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a316 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.968170:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a316 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.968179:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784186674.968588:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.968594:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbd64d27/0x55bc3e8c99d1a31d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.968602:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.968605:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.968610:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd64d27/0x55bc3e8c99d1a31d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.968619:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbd64d27/0x55bc3e8c99d1a31d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.968626:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbd64d27/0x55bc3e8c99d1a31d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.968632:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbd64d27/0x55bc3e8c99d1a31d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.968641:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784186674.969032:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.969038:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a324 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.969053:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.969056:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.969060:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a324 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.969068:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a324 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.969076:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a324 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.969083:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a324 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.969092:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1784186674.969492:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.969499:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006200421a/0x55bc3e8c99d1a32b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.969507:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.969509:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.969513:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006200421a/0x55bc3e8c99d1a32b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.969522:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006200421a/0x55bc3e8c99d1a32b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.969540:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006200421a/0x55bc3e8c99d1a32b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.969547:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006200421a/0x55bc3e8c99d1a32b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.969555:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1784186674.969942:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1784186674.969952:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d1a30f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.969962:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186674.969966:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d1a30f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.969974:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d1a30f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.969992:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d1a30f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186674.969999:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000179b882c/0x55bc3e8c99d1a30f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972612:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784186674.972624:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a316 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972638:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27edc00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.972642:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a316 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972651:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a316 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972670:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a316 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972677:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f79a2d4/0x55bc3e8c99d1a316 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972718:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784186674.972722:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbd64d27/0x55bc3e8c99d1a31d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972737:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec800 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.972741:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd64d27/0x55bc3e8c99d1a31d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972748:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbd64d27/0x55bc3e8c99d1a31d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972758:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbd64d27/0x55bc3e8c99d1a31d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972766:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbd64d27/0x55bc3e8c99d1a31d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972779:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784186674.972783:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a324 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972789:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ec400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.972792:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a324 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972877:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a324 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972889:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a324 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972896:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8a9ed3f/0x55bc3e8c99d1a324 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972909:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186674.972913:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006200421a/0x55bc3e8c99d1a32b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972919:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ed800 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.972922:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006200421a/0x55bc3e8c99d1a32b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972929:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006200421a/0x55bc3e8c99d1a32b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972938:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006200421a/0x55bc3e8c99d1a32b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972944:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006200421a/0x55bc3e8c99d1a32b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.972969:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.972970:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.972972:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.972979:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.972981:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.972982:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784186674.973366:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.973375:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a332 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.973388:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.973392:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.973399:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a332 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.973411:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a332 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.973420:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a332 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.973428:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a332 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.975600:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784186674.975906:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186674.975915:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a332 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.975925:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5d200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.975930:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a332 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.975938:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a332 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.975957:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a332 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.975964:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a332 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.975985:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.975987:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.975988:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784186674.976957:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.976965:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc25fb4d/0x55bc3e8c99d1a339 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.976978:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.976982:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.976989:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc25fb4d/0x55bc3e8c99d1a339 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.977000:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc25fb4d/0x55bc3e8c99d1a339 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.977009:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc25fb4d/0x55bc3e8c99d1a339 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.977017:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc25fb4d/0x55bc3e8c99d1a339 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.977072:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784186674.977586:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.977593:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f9927d/0x55bc3e8c99d1a340 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.977602:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.977612:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.977616:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f9927d/0x55bc3e8c99d1a340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.977626:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9f9927d/0x55bc3e8c99d1a340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.977634:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9f9927d/0x55bc3e8c99d1a340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.977640:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9f9927d/0x55bc3e8c99d1a340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.981648:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784186674.981660:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc25fb4d/0x55bc3e8c99d1a339 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.981676:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5de00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.981681:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc25fb4d/0x55bc3e8c99d1a339 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.981693:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc25fb4d/0x55bc3e8c99d1a339 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.981724:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc25fb4d/0x55bc3e8c99d1a339 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.981740:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc25fb4d/0x55bc3e8c99d1a339 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.981767:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186674.981771:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9f9927d/0x55bc3e8c99d1a340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.981778:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5d000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.981781:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f9927d/0x55bc3e8c99d1a340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.981788:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9f9927d/0x55bc3e8c99d1a340 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.981909:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9f9927d/0x55bc3e8c99d1a340 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.981919:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.981921:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.981923:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1784186674.985483:0:15513:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00010000:00010000:0.0:1784186674.987296:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.987301:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784186674.987313:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9f9927d/0x55bc3e8c99d1a340 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784186674.987981:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784186674.987987:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a02859bc/0x55bc3e8c99d1a347 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.987998:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1784186674.988002:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186674.988006:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a02859bc/0x55bc3e8c99d1a347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.988018:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a02859bc/0x55bc3e8c99d1a347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.988030:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a02859bc/0x55bc3e8c99d1a347 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.988034:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a02859bc/0x55bc3e8c99d1a347 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.988048:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784186674.988071:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186674.988079:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a02859bc/0x55bc3e8c99d1a347 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.988088:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5da00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186674.988093:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a02859bc/0x55bc3e8c99d1a347 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.988103:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a02859bc/0x55bc3e8c99d1a347 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.988121:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a02859bc/0x55bc3e8c99d1a347 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.988129:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a02859bc/0x55bc3e8c99d1a347 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.988143:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.988145:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.988152:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1784186674.988652:0:15513:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00002000:00010000:0.0:1784186674.989186:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.989193:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a34e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.989203:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.989207:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.989211:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a34e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.989222:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a34e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.989230:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a34e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.989237:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a34e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.989259:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784186674.989415:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186674.989422:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a34e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.989430:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fae00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186674.989433:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a34e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.989477:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a34e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.989490:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a34e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.989498:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000835e1353/0x55bc3e8c99d1a34e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.989516:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.989524:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.989526:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1784186674.989796:0:15513:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00002000:00010000:0.0:1784186674.989996:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.990003:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a355 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.990012:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.990016:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.990021:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1784186674.990040:0:15513:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00010000:00010000:0.0:1784186674.990040:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.990049:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.990057:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.990085:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784186674.990820:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186674.990828:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.990838:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186674.990842:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.990851:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.990865:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a355 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.990874:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dd5d0c7/0x55bc3e8c99d1a355 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.990889:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.990890:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.990892:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784186674.991048:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.991055:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a35c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.991064:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.991068:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.991073:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a35c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.991082:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a35c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.991090:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a35c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.991108:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a35c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.991153:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784186674.991631:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.991637:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a363 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.991646:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.991649:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.991653:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.991663:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.991670:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.991678:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1784186674.991869:0:15513:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00010000:00010000:1.0:1784186674.992021:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784186674.992028:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a35c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.992037:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186674.992040:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a35c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.992054:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a35c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.992068:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a35c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.992076:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000924e0aec/0x55bc3e8c99d1a35c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.992093:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186674.992096:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.992103:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186674.992106:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.992114:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a363 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.992124:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a363 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.992131:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.992132:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.992139:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.992207:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784186674.992213:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c9bf58c/0x55bc3e8c99d1a363 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784186674.993067:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784186674.993075:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2409969/0x55bc3e8c99d1a36a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.993085:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1784186674.993089:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186674.993094:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2409969/0x55bc3e8c99d1a36a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.993104:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2409969/0x55bc3e8c99d1a36a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.993113:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2409969/0x55bc3e8c99d1a36a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186674.993119:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2409969/0x55bc3e8c99d1a36a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.993252:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186674.993258:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2409969/0x55bc3e8c99d1a36a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.993266:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fba00 already unused, calling callback (ffffffffc1768230) 00100000:10000000:3.0:1784186674.993267:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 513: rc = 0 00010000:00010000:1.0:1784186674.993270:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2409969/0x55bc3e8c99d1a36a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.993278:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2409969/0x55bc3e8c99d1a36a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.993291:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2409969/0x55bc3e8c99d1a36a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186674.993299:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.993300:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186674.993302:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186674.993409:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00100000:10000000:3.0:1784186674.993412:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 513: rc = 0 00010000:00010000:0.0:1784186674.993414:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2409969/0x55bc3e8c99d1a36a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:3.0:1784186674.993524:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 513: rc = 0 00010000:00010000:1.0:1784186674.993629:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784186674.993978:0:14848:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00100000:10000000:3.0:1784186674.994022:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 657: rc = 0 00000100:00100000:0.0:1784186674.994083:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14235:x1870854938000512:12345-0@lo:5:osp-pre-0-0.0 Request processed in 106860us (107023us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186674.994100:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784186674.994192:0:14235:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14235:1870854938000512:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784186674.994206:0:14235:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1784186674.994253:0:14235:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14235:1870854938000640:0@lo:5:osp-pre-0-0.0 00100000:10000000:3.0:1784186674.994262:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 657: rc = 0 00000100:00100000:1.0:1784186674.994288:0:14235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186674.994366:0:14235:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651d240 going to sleep for 11 seconds 00000100:00100000:2.0:1784186674.994401:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938000640 00000100:00100000:2.0:1784186674.994408:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938000640 00100000:10000000:3.0:1784186674.994524:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 657: rc = 0 00000100:00100000:2.0:1784186674.994585:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784186674.994595:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14235:x1870854938000640:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784186674.994628:0:14845:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00100000:10000000:3.0:1784186674.995245:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 657: rc = 0 00100000:10000000:3.0:1784186674.995668:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 657: rc = 0 00100000:10000000:3.0:1784186674.995987:0:15513:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 657: rc = 0 00000020:00000080:3.0:1784186674.997917:0:15513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1784186674.997932:0:15513:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784186674.997943:0:15513:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x55bc3e8c99d1a371 00000020:01000004:3.0:1784186674.997953:0:15513:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1784186674.997976:0:15513:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.131@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784186674.997979:0:15513:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.131@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784186674.997985:0:15513:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1784186674.998007:0:15513:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1784186674.998012:0:15513:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.131@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:0.0:1784186675.003139:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14235:x1870854938000640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8538us (8843us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1784186675.003154:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784186675.003261:0:14235:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14235:1870854938000640:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784186675.003281:0:14235:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000040:01000000:2.0:1784186675.011396:0:15513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.131@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784186675.011436:0:15513:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.131@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1784186675.011801:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784186675.011803:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784186675.011804:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186675.011864:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186675.011866:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186675.011868:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186675.011869:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784186675.011871:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186675.011873:0:15513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784186675.011877:0:15513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1784186675.011879:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784186675.011881:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784186675.011882:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784186675.011883:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784186675.011884:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784186675.011885:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784186675.011886:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784186675.011887:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784186675.011888:0:15513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784186675.011917:0:15513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784186675.011939:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938000768:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784186675.012016:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186675.012112:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc2a32780 going to sleep for 11 seconds 00000100:00100000:3.0:1784186675.012165:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938000768 00000100:00100000:3.0:1784186675.012173:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938000768 00000100:00100000:3.0:1784186675.012257:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784186675.012267:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:15513:x1870854938000768:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784186675.012316:0:14206:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1784186675.012319:0:14206:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1784186675.012322:0:14206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1784186675.020019:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:15513:x1870854938000768:12345-0@lo:253:mount.lustre.0 Request processed in 7743us (7993us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186675.020034:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784186675.020303:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938000768:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784186675.020318:0:15513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784186675.020322:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784186675.020324:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784186675.020325:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784186675.020326:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784186675.020327:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784186675.020328:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784186675.020330:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784186675.020331:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784186675.020332:0:15513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784186675.020352:0:15513:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9b9fc8258800 from lustre-OST0001 10000000:01000000:0.0:1784186675.020381:0:15513:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1784186675.020383:0:15513:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784186675.020392:0:15513:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9b9ec681cd40 local copy 00010000:00010000:0.0:1784186675.020404:0:15513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a11e expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186675.020786:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938000896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784186675.020896:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186675.021059:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784186675.021213:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938000896 00000100:00100000:1.0:1784186675.021221:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938000896 00000100:00100000:1.0:1784186675.021305:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784186675.021315:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:15513:x1870854938000896:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784186675.021898:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:15513:x1870854938000896:12345-0@lo:501:mount.lustre.0 Request processed in 582us (1000us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784186675.021906:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784186675.022058:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938000896:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784186675.022076:0:15513:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.131@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784186675.022221:0:15513:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.131@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784186675.022230:0:15513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a11e expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.022247:0:15513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d600/0x55bc3e8c99d1a117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a11e expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186675.022283:0:15513:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9b9fc8258800 10000000:01000000:0.0:1784186675.022288:0:15513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784186675.022294:0:15513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784186675.022296:0:15513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784186675.022301:0:15513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1784186675.022304:0:15513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784186675.022333:0:15513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fba00/0x55bc3e8c99d1a378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.022341:0:15513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fba00/0x55bc3e8c99d1a378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.022365:0:15513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fba00/0x55bc3e8c99d1a378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186675.022383:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784186675.022413:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186675.022469:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784186675.022610:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938001024 00000100:00100000:1.0:1784186675.022616:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938001024 00000100:00100000:1.0:1784186675.022688:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784186675.022697:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:15513:x1870854938001024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784186675.022709:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186675.022723:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffcc5d000/0x55bc3e8c99d1a37f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a378 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.022756:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffcc5d000/0x55bc3e8c99d1a37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a378 expref: 17 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.022766:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffcc5d000/0x55bc3e8c99d1a37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a378 expref: 17 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.022775:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffcc5d000, rc 0) 00000100:00100000:1.0:1784186675.022822:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:15513:x1870854938001024:12345-0@lo:101:mount.lustre.0 Request processed in 126us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186675.022828:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784186675.023154:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784186675.023167:0:15513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fba00/0x55bc3e8c99d1a378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a37f expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.023176:0:15513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fba00/0x55bc3e8c99d1a378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a37f expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784186675.023949:0:15513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1784186675.025089:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784186675.025340:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1784186675.025386:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1784186675.025422:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1784186675.025893:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1784186675.025935:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1784186675.025968:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1784186675.026036:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1784186675.026044:0:15513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1784186675.026156:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784186675.026230:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186675.026323:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1784186675.026364:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938001152 00000100:00100000:1.0:1784186675.026371:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938001152 00000100:00100000:0.0:1784186675.026655:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784186675.026666:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:15513:x1870854938001152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784186675.027115:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:15513:x1870854938001152:12345-0@lo:501:mount.lustre.0 Request processed in 450us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186675.027123:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784186675.027213:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186675.027249:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784186675.027290:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186675.027514:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc2a32000 going to sleep for 11 seconds 00000100:00100000:3.0:1784186675.027654:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938001280 00000100:00100000:3.0:1784186675.027660:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938001280 00000100:00100000:3.0:1784186675.027693:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784186675.027699:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:15513:x1870854938001280:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784186675.028170:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:15513:x1870854938001280:12345-0@lo:503:mount.lustre.0 Request processed in 469us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186675.028179:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784186675.028263:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001280:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784186675.029219:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784186675.029308:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784186675.029368:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186675.029522:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd6273c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784186675.029660:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938001408 00000100:00100000:1.0:1784186675.029667:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938001408 00000100:00100000:2.0:1784186675.030130:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784186675.030150:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:15513:x1870854938001408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784186675.030392:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:15513:x1870854938001408:12345-0@lo:502:mount.lustre.0 Request processed in 245us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186675.030400:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784186675.030536:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001408:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784186675.030946:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1784186675.031004:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1784186675.031051:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1784186675.031099:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1784186675.031132:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1784186675.031163:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1784186675.031221:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1784186675.031258:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1784186675.031313:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1784186675.031352:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784186675.031397:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186675.031538:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186675.031668:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938001536 00000100:00100000:3.0:1784186675.031674:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938001536 00000100:00100000:3.0:1784186675.031704:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784186675.031712:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:15513:x1870854938001536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784186675.031960:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:15513:x1870854938001536:12345-0@lo:502:mount.lustre.0 Request processed in 248us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186675.031968:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1784186675.032058:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784186675.032134:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1784186675.032144:0:15513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1784186675.033111:0:15515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784186675.033124:0:15515:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1784186675.033130:0:15515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186675.033132:0:15515:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1784186675.033138:0:15515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784186675.033151:0:15515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9b9fd18519c0) 00000020:00000080:3.0:1784186675.033177:0:15515:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784186675.033184:0:15515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784186675.033256:0:15515:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b9fc8258800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1784186675.033263:0:15515:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784186675.033269:0:15515:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x55bc3e8c99d1a38d 00010000:00010000:2.0:1784186675.038217:0:15515:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1784186675.038769:0:15515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1784186675.040915:0:15515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1784186675.042433:0:15515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1784186675.042881:0:15515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186675.042889:0:15515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186675.042892:0:15515:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1784186675.042899:0:15515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186675.042904:0:15515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186675.042905:0:15515:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784186675.042908:0:15515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784186675.042910:0:15515:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784186675.042913:0:15515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186675.042915:0:15515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186675.042916:0:15515:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784186675.042918:0:15515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784186675.042920:0:15515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186675.042921:0:15515:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784186675.042925:0:15515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784186675.042983:0:15515:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186675.042987:0:15515:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186675.042988:0:15515:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784186675.042991:0:15515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1784186675.043150:0:15513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1784186675.043186:0:15513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784186675.043208:0:15513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fba00/0x55bc3e8c99d1a378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a37f expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.043221:0:15513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fba00/0x55bc3e8c99d1a378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a37f expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186675.043229:0:15513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc8258800 from 1 10000000:01000000:0.0:1784186675.043232:0:15513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784186675.043266:0:15513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.043274:0:15513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.043286:0:15513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186675.043314:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784186675.043385:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186675.044641:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186675.045778:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938001664 00000100:00100000:3.0:1784186675.045791:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938001664 00000100:00100000:3.0:1784186675.045857:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784186675.045868:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:15513:x1870854938001664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784186675.045893:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186675.045911:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a39b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a394 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186675.045938:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a394 expref: 18 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186675.045949:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a394 expref: 18 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186675.045958:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fda505a00, rc 0) 00000100:00100000:3.0:1784186675.047654:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:15513:x1870854938001664:12345-0@lo:101:mount.lustre.0 Request processed in 1784us (4266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186675.047664:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784186675.047782:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784186675.047868:0:15513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.047882:0:15513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784186675.048390:0:15513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1784186675.049208:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784186675.049424:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1784186675.049926:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1784186675.050001:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1784186675.050010:0:15513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1784186675.050092:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784186675.050155:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186675.051474:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784186675.053405:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938001792 00000100:00100000:2.0:1784186675.053419:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938001792 00000100:00100000:2.0:1784186675.053710:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784186675.053722:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:15513:x1870854938001792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186675.054100:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:15513:x1870854938001792:12345-0@lo:501:mount.lustre.0 Request processed in 379us (3942us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186675.054108:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784186675.054215:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784186675.054269:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784186675.054322:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186675.054359:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651d180 going to sleep for 11 seconds 00000100:00100000:0.0:1784186675.054403:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938001920 00000100:00100000:0.0:1784186675.054408:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938001920 00000100:00100000:0.0:1784186675.054465:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784186675.054481:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:15513:x1870854938001920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784186675.054704:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:15513:x1870854938001920:12345-0@lo:503:mount.lustre.0 Request processed in 232us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186675.054711:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784186675.054924:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938001920:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784186675.055582:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784186675.055663:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784186675.055711:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186675.055744:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651d180 going to sleep for 11 seconds 00000100:00100000:2.0:1784186675.055933:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938002048 00000100:00100000:2.0:1784186675.055939:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938002048 00000100:00100000:2.0:1784186675.055979:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784186675.055988:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:15513:x1870854938002048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784186675.056176:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4203450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:15513:x1870854938002048:12345-0@lo:502:mount.lustre.0 Request processed in 189us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186675.056184:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784186675.056311:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784186675.056969:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1784186675.057019:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1784186675.057065:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1784186675.057102:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1784186675.057135:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1784186675.057180:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1784186675.057218:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1784186675.057255:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1784186675.057287:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe063b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784186675.057338:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186675.057416:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec651d180 going to sleep for 11 seconds 00000100:00100000:2.0:1784186675.058117:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938002176 00000100:00100000:2.0:1784186675.058125:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938002176 00000100:00100000:2.0:1784186675.058201:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1784186675.058209:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:15513:x1870854938002176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784186675.058406:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:15513:x1870854938002176:12345-0@lo:502:mount.lustre.0 Request processed in 196us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186675.058414:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784186675.058576:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe063b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784186675.058679:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1784186675.058690:0:15513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1784186675.059525:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784186675.059535:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186675.059537:0:15519:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784186675.059545:0:15519:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9fc8258800 00000020:00000080:3.0:1784186675.059547:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784186675.059554:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186675.059557:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186675.059558:0:15519:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784186675.059560:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784186675.059562:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186675.059564:0:15519:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784186675.059567:0:15519:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b9fc8258800 00000020:00000080:3.0:1784186675.059569:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784186675.059622:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784186675.061630:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186675.061638:0:15519:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784186675.061647:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784186675.061659:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784186675.061660:0:15519:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784186675.061665:0:15519:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9b9fc8258800 00000020:00000080:3.0:1784186675.061668:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784186675.067676:0:15519:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784186675.067692:0:15519:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784186675.067694:0:15519:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784186675.067703:0:15519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1784186675.069624:0:15513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1784186675.069671:0:15513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784186675.069692:0:15513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186675.069705:0:15513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186675.069784:0:15513:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784186675.069787:0:15513:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9b9fc8258800 10000000:01000000:2.0:1784186675.069791:0:15513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9b9fc8258800 10000000:01000000:2.0:1784186675.069795:0:15513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784186675.069802:0:15513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9b9fc8258800 from 1 10000000:01000000:2.0:1784186675.069805:0:15513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784186675.069910:0:15513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766da00/0x55bc3e8c99d1a3a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186675.069918:0:15513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc766da00/0x55bc3e8c99d1a3a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186675.069927:0:15513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc766da00/0x55bc3e8c99d1a3a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186675.069953:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784186675.070020:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186675.070072:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1dbe180 going to sleep for 11 seconds 00000100:00100000:1.0:1784186675.070588:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938002304 00000100:00100000:1.0:1784186675.070596:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938002304 00000100:00100000:1.0:1784186675.070646:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784186675.070656:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:15513:x1870854938002304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784186675.070671:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186675.070692:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffcc5dc00/0x55bc3e8c99d1a3a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a3a2 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.070718:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffcc5dc00/0x55bc3e8c99d1a3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a3a2 expref: 19 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.070738:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffcc5dc00/0x55bc3e8c99d1a3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a3a2 expref: 19 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.070746:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffcc5dc00, rc 0) 00000100:00100000:1.0:1784186675.070792:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:15513:x1870854938002304:12345-0@lo:101:mount.lustre.0 Request processed in 137us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186675.070798:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784186675.070936:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784186675.070952:0:15513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc766da00/0x55bc3e8c99d1a3a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a3a9 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186675.070961:0:15513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766da00/0x55bc3e8c99d1a3a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a3a9 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784186675.074130:0:15513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1784186675.076031:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784186675.076385:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1784186675.076464:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1784186675.077636:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1784186675.077704:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1784186675.077753:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1784186675.078606:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1784186675.078661:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1784186675.078698:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1784186675.078760:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1784186675.078794:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1784186675.080407:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1784186675.080601:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1784186675.080642:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1784186675.080678:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1784186675.080735:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1784186675.080772:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1784186675.081903:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1784186675.082000:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1784186675.082037:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1784186675.082069:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1784186675.082113:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1784186675.082165:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1784186675.082200:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1784186675.082258:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1784186675.082298:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1784186675.082333:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1784186675.082382:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1784186675.082418:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1784186675.083544:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1784186675.083640:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1784186675.083674:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1784186675.083708:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1784186675.083752:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1784186675.083798:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1784186675.084614:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1784186675.084670:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1784186675.084708:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1784186675.084906:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1784186675.084915:0:15513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1784186675.085027:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186675.085102:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186675.085158:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1dbe180 going to sleep for 11 seconds 00000100:00100000:3.0:1784186675.088109:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938002432 00000100:00100000:3.0:1784186675.088122:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938002432 00000100:00100000:3.0:1784186675.088184:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784186675.088194:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:15513:x1870854938002432:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784186675.088538:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:15513:x1870854938002432:12345-0@lo:501:mount.lustre.0 Request processed in 345us (3435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186675.088547:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784186675.093080:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784186675.093148:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784186675.093227:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186675.093278:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1dbe180 going to sleep for 11 seconds 00000100:00100000:1.0:1784186675.093920:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938002560 00000100:00100000:1.0:1784186675.093928:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938002560 00000100:00100000:1.0:1784186675.093989:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784186675.093999:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:15513:x1870854938002560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784186675.094379:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4201050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:15513:x1870854938002560:12345-0@lo:503:mount.lustre.0 Request processed in 381us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186675.094388:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784186675.094646:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002560:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784186675.095328:0:15513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784186675.095403:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784186675.095504:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186675.095535:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1dbe180 going to sleep for 11 seconds 00000100:00100000:3.0:1784186675.097606:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938002688 00000100:00100000:3.0:1784186675.097618:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938002688 00000100:00100000:3.0:1784186675.097688:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784186675.097699:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:15513:x1870854938002688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784186675.098128:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:15513:x1870854938002688:12345-0@lo:502:mount.lustre.0 Request processed in 429us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186675.098137:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784186675.098601:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784186675.099020:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1784186675.099075:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1784186675.099111:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1784186675.099157:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1784186675.099193:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1784186675.099239:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1784186675.099274:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1784186675.099306:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1784186675.099366:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1784186675.099411:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1784186675.102758:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1784186675.102904:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1784186675.102947:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1784186675.103004:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1784186675.103058:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1784186675.103096:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1784186675.103141:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1784186675.103189:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1784186675.103222:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1784186675.103255:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1784186675.103303:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1784186675.103341:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1784186675.103378:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1784186675.103427:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1784186675.103621:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1784186675.103661:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1784186675.103709:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1784186675.103757:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1784186675.103794:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1784186675.104032:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1784186675.104070:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1784186675.104100:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1784186675.104132:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1784186675.104193:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1784186675.104232:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1784186675.104283:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1784186675.104320:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1784186675.104351:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1784186675.104399:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1784186675.104435:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1784186675.104589:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784186675.104667:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186675.104711:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f240 going to sleep for 11 seconds 00000100:00100000:3.0:1784186675.105133:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938002816 00000100:00100000:3.0:1784186675.105141:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938002816 00000100:00100000:3.0:1784186675.105200:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1784186675.105210:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:15513:x1870854938002816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784186675.105553:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:15513:x1870854938002816:12345-0@lo:502:mount.lustre.0 Request processed in 344us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186675.105562:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784186675.106140:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938002816:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784186675.106247:0:15513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1784186675.106262:0:15513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1784186675.110435:0:15524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784186675.110674:0:15524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ba001a50000) 00000020:00000080:2.0:1784186675.110700:0:15524:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1784186675.110979:0:15524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9b9fc8258800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784186675.110984:0:15524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9b9fc8258800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784186675.110987:0:15524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9b9fc8258800 3 00010000:00080000:2.0:1784186675.111020:0:15524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9b9ffeda3800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.131@tcp at head 00010000:00010000:2.0:1784186675.113374:0:15524:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1784186675.114658:0:15524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784186675.114703:0:15524:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784186675.114716:0:15524:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x55bc3e8c99d1a3b7 00000100:00080000:2.0:1784186675.114737:0:15524:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784186675.114743:0:15524:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9b9ffeda3800 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1784186675.114781:0:15524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffeeb1f80 x1870854938002944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784186675.115599:0:15524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784186675.116891:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1870854938002944:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784186675.116971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186675.117085:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938002944 00000100:00100000:2.0:1784186675.117092:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938002944 00000100:00100000:2.0:1784186675.117132:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784186675.117139:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1870854938002944:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784186675.117166:0:14213:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:2.0:1784186675.117201:0:14213:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x55bc3e8c99d1a3be 00000004:00100000:2.0:1784186675.117216:0:14213:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784186675.117247:0:14213:0:(import.c:65:import_set_state_nolock()) ffff9b9ffe377800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784186675.117309:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe063b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1870854938002944:12345-0@lo:38:llog_process_th.0 Request processed in 168us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186675.117317:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784186675.117358:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9b9ffeeb1f80 x1870854938002944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784186685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186675.117368:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784186675.117375:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1784186675.117381:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784186675.117385:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784186675.117387:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeda3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784186675.117393:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1870854938002944:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1784186675.120200:0:15524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1784186675.123193:0:15513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784186675.123236:0:15513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784186675.123260:0:15513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766da00/0x55bc3e8c99d1a3a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a3a9 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.123291:0:15513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc766da00/0x55bc3e8c99d1a3a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a3a9 expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784186675.123339:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784186675.123341:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784186675.123343:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784186675.123344:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784186675.123345:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784186675.123346:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784186675.123347:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784186675.123349:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784186675.123350:0:15513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784186675.123355:0:15513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1784186675.123357:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784186675.123359:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784186675.123360:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784186675.123361:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784186675.123362:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784186675.123363:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784186675.123364:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784186675.123365:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784186675.123366:0:15513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784186675.123391:0:15513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784186675.123412:0:15513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938003072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784186675.123520:0:15513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186675.123557:0:15513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784186675.123743:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938003072 00000100:00100000:3.0:1784186675.123751:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938003072 00000100:00100000:3.0:1784186675.123801:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784186675.123888:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:15513:x1870854938003072:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784186675.123920:0:14206:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1784186675.123933:0:14206:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784186675.146797:0:14206:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784186675.146822:0:14206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1784186675.146858:0:14228:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784186675.146862:0:14228:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784186675.146887:0:14228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.146905:0:14228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc766d800/0x55bc3e8c99d1a298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a291 expref: 19 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.146928:0:14228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.146972:0:14228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc766d800/0x55bc3e8c99d1a298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d1a291 expref: 19 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.146987:0:14228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9fc766d800/0x55bc3e8c99d1a298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a291 expref: 19 pid: 14206 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186675.147004:0:14228:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14228:1870854938003200:0@lo:104: 00000100:00100000:0.0:1784186675.147066:0:14228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186675.147104:0:14228:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784186675.147127:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938003200 00000100:00100000:0.0:1784186675.147135:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938003200 00000100:00100000:0.0:1784186675.147175:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784186675.147184:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+3:14228:x1870854938003200:12345-0@lo:104: 00010000:00010000:0.0:1784186675.147197:0:14195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.147245:0:14195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784186675.147251:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+3:14228:x1870854938003200:12345-0@lo:104: Request processed in 68us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186675.147258:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1784186675.147279:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186675.147285:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.147293:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27eca00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:0.0:1784186675.147303:0:14201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.147312:0:14201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784186675.147319:0:14201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784186675.147325:0:14201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784186675.147352:0:14201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.147357:0:14201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784186675.147375:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.147381:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc27eca00/0x55bc3e8c99d1a291 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a298 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186675.147396:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186675.147398:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186675.147400:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186675.147413:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784186675.147424:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3306:1870854938003328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784186675.147744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186675.147846:0:14228:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14228:1870854938003200:0@lo:104: 00010000:00010000:0.0:1784186675.147863:0:14228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186675.150414:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938003328 00000100:00100000:1.0:1784186675.150428:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938003328 00010000:00010000:1.0:1784186675.150679:0:14199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc766d800/0x55bc3e8c99d1a298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a291 expref: 20 pid: 14206 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186675.150721:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784186675.150740:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+20:3306:x1870854938003328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784186675.150768:0:14199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186675.150774:0:14199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc766d800/0x55bc3e8c99d1a298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a291 expref: 20 pid: 14206 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.150785:0:14199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc766d800/0x55bc3e8c99d1a298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a291 expref: 20 pid: 14206 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.150816:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc766d800/0x55bc3e8c99d1a298 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d1a291 expref: 20 pid: 14206 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.150839:0:14199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.150847:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784186675.150865:0:14199:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004002776s 00010000:00010000:1.0:1784186675.150869:0:14199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.150876:0:14199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.150882:0:14199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.150889:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.150894:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186675.150898:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.150913:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186675.153306:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:15513:x1870854938003072:12345-0@lo:253:mount.lustre.0 Request processed in 29410us (29774us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186675.153323:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1784186675.153434:0:15513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:15513:1870854938003072:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784186675.153494:0:15513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784186675.153497:0:15513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784186675.153499:0:15513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784186675.153500:0:15513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784186675.153501:0:15513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784186675.153503:0:15513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784186675.153504:0:15513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784186675.153506:0:15513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784186675.153507:0:15513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784186675.153509:0:15513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784186675.153528:0:15513:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1784186675.157023:0:14228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186675.157039:0:14228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.157349:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.157358:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a3c5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186675.157375:0:14199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186675.157597:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3306:1870854938003328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784186675.157675:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:3306:x1870854938003328:12345-0@lo:103:ldlm_bl.0 Request processed in 6726us (9719us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186675.157689:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00080000:10000000:0.0:1784186675.158160:0:15513:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1784186675.158327:0:15513:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1784186675.158626:0:15513:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1784186675.158791:0:15513:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1784186675.159022:0:15513:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1784186675.159251:0:15513:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1784186675.160312:0:15513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1784186675.210428:0:15513:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1784186675.210437:0:15513:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1784186675.210607:0:15513:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784186675.210670:0:15513:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.131@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784186675.210688:0:15513:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1784186675.210721:0:15513:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1784186675.966161:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784186676.413526:0:14209:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784186676.413537:0:14209:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9b9fc7fc5000 from 8 10000000:01000000:0.0:1784186676.413656:0:14209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784186676.413717:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fa400/0x55bc3e8c99d1a3cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186676.413730:0:14209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fa400/0x55bc3e8c99d1a3cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186676.413756:0:14209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fa400/0x55bc3e8c99d1a3cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186676.413796:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938003456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784186676.413883:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186676.414020:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd11d3180 going to sleep for 11 seconds 00000100:00100000:2.0:1784186676.417438:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938003456 00000100:00100000:2.0:1784186676.417557:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938003456 00000100:00100000:2.0:1784186676.417695:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784186676.417715:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:14209:x1870854938003456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784186676.417735:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186676.417764:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9fc766d200/0x55bc3e8c99d1a3d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a3cc expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186676.417809:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9fc766d200/0x55bc3e8c99d1a3d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a3cc expref: 19 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186676.417835:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9fc766d200/0x55bc3e8c99d1a3d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a3cc expref: 19 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186676.417845:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d200, rc 0) 00000100:00100000:2.0:1784186676.417942:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:14209:x1870854938003456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186676.417949:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784186676.418054:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938003456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784186676.418075:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fa400/0x55bc3e8c99d1a3cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a3d3 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186676.418085:0:14209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fa400/0x55bc3e8c99d1a3cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a3d3 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186676.418159:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938003584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784186676.418202:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186676.428073:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd13fe600 going to sleep for 11 seconds 00000100:00100000:0.0:1784186676.430357:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938003584 00000100:00100000:0.0:1784186676.430373:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938003584 00000100:00100000:0.0:1784186676.430434:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784186676.430474:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:14209:x1870854938003584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784186676.430506:0:14207:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784186676.430525:0:14207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784186676.430528:0:14207:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1784186676.430671:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:14209:x1870854938003584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 228us (12468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186676.430679:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784186676.431079:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938003584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784186676.431155:0:14209:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784186676.431165:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fa400/0x55bc3e8c99d1a3cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a3d3 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186676.431176:0:14209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fa400/0x55bc3e8c99d1a3cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a3d3 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186676.994018:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186678.014648:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784186678.082708:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1784186678.082726:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1784186679.037946:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186679.997916:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854938003712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784186679.997995:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186679.998077:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938003712 00000100:00100000:2.0:1784186679.998085:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938003712 00000100:00100000:2.0:1784186679.998140:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784186679.998151:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854938003712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784186679.998189:0:14849:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186679.998235:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854938003712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186679.998243:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1784186679.998264:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784186679.998291:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1784186679.998312:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854938003712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784186680.069899:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784186680.511567:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784186680.511575:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784186680.511579:0:37:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeb88000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784186680.511589:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:2.0:1784186680.511595:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784186680.511610:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9b9ffeb88000 using connection 192.168.201.131@tcp/0@lo 00000100:00100000:2.0:1784186680.512596:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9b9ffeeb3480 x1870854938004096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784186680.512859:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3309:1870854938003840:0@lo:400:kworker.0 00000100:00100000:2.0:1784186680.512932:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186680.512990:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854938004480:0@lo:400:kworker.0 00000100:00100000:2.0:1784186680.513016:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186680.513048:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784186680.513054:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854938004352:0@lo:400:kworker.0 00000100:00100000:2.0:1784186680.513080:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186680.513110:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854938003968:0@lo:400:kworker.0 00000100:00100000:2.0:1784186680.513134:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186680.513156:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784186680.513161:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854938004224:0@lo:400:kworker.0 00000100:00100000:2.0:1784186680.513186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186680.513217:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854938004096:0@lo:8:kworker.0 00000100:00100000:2.0:1784186680.513243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186680.513275:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938004480 00000100:00100000:2.0:1784186680.513284:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938004480 00000100:00100000:0.0:1784186680.513816:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938003968 00000100:00100000:0.0:1784186680.513822:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938003968 00000100:00100000:0.0:1784186680.513858:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938004096 00000100:00100000:0.0:1784186680.513861:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938004096 00000100:00100000:0.0:1784186680.513875:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784186680.513885:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854938003968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186680.513951:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854938003968:12345-0@lo:400:kworker.0 Request processed in 67us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186680.513959:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784186680.513987:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784186680.513992:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1870854938004096:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1784186680.514019:0:14848:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1784186680.514051:0:14848:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x55bc3e8c99d1a3da 00002000:00100000:0.0:1784186680.514070:0:14848:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9b9fccb47000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784186680.514074:0:14848:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784186680.514077:0:14848:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784186680.514487:0:14848:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784186680.514514:0:14848:0:(import.c:65:import_set_state_nolock()) ffff9b9fccb44800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784186680.514564:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1870854938004096:12345-0@lo:8:kworker.0 Request processed in 570us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186680.514571:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784186680.515823:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938003840 00000100:00100000:3.0:1784186680.515835:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938003840 00000100:00100000:3.0:1784186680.515873:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784186680.515880:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:3309:x1870854938003840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186680.515944:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:3309:x1870854938003840:12345-0@lo:400:kworker.0 Request processed in 64us (3012us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186680.515950:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784186680.516019:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938004352 00000100:00100000:2.0:1784186680.516024:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938004352 00000100:00100000:2.0:1784186680.516046:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938004224 00000100:00100000:2.0:1784186680.516049:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938004224 00000100:00100000:2.0:1784186680.516060:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784186680.516066:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854938004480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186680.516103:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854938004480:12345-0@lo:400:kworker.0 Request processed in 37us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186680.516116:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784186680.516131:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784186680.516136:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854938004352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186680.516164:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854938004352:12345-0@lo:400:kworker.0 Request processed in 29us (3084us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186680.516170:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784186680.516179:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784186680.516184:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854938004224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186680.516208:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854938004224:12345-0@lo:400:kworker.0 Request processed in 24us (3022us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186680.516214:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1784186680.516237:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784186680.516269:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffeeb3480 x1870854938004096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784186705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186680.516280:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784186680.516289:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1784186680.516297:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784186680.516302:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784186680.516305:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeb88000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784186680.516782:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784186680.516791:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1870854938004096:0@lo:8:kworker.0 00000004:00080000:2.0:1784186680.516827:0:14236:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784186680.517276:0:14236:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 459238833386ns, next at 0ns, rc = 0 00010000:00080000:2.0:1784186680.517352:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffeeb1880 x1870854938004224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186680.517377:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854938004224:0@lo:400:kworker.0 00000100:00100000:2.0:1784186680.517395:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854938003968:0@lo:400:kworker.0 00010000:00080000:2.0:1784186680.517427:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffeeb1180 x1870854938004352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186680.517435:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854938004352:0@lo:400:kworker.0 00000100:00100000:2.0:1784186680.517462:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3309:1870854938003840:0@lo:400:kworker.0 00010000:00080000:2.0:1784186680.517473:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffeeb3b80 x1870854938004480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784186696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784186680.517481:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854938004480:0@lo:400:kworker.0 00000100:00100000:3.0:1784186680.522184:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784186680.522208:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938004608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784186680.522297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186680.522366:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938004608 00000100:00100000:3.0:1784186680.522374:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938004608 00000100:00100000:3.0:1784186680.522432:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784186680.522467:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854938004608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784186680.522504:0:14849:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784186680.522550:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854938004608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186680.522558:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1784186680.522578:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784186680.522610:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9b9ffeeb7b80 x1870854938004608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784186696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784186680.522650:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938004608:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1784186680.522927:0:14237:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1784186680.522951:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14237:1870854938004736:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784186680.522978:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186680.523007:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938004736 00000100:00100000:3.0:1784186680.523010:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938004736 00000100:00100000:3.0:1784186680.523035:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784186680.523041:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14237:x1870854938004736:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1784186680.528699:0:14848:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1784186680.528711:0:14848:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1784186680.528718:0:14848:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00100000:0.0:1784186680.534991:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe547ce40 going to sleep for 11 seconds 00002000:00010000:3.0:1784186680.539927:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.539943:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d1a3e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.539975:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.539981:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.539989:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d1a3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.540008:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d1a3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.540020:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d1a3e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.540029:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d1a3e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.543591:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784186680.543710:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186680.543732:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d1a3e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.543748:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505c00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186680.543753:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d1a3e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.543765:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d1a3e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.543793:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d1a3e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.543814:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000088fbaaf/0x55bc3e8c99d1a3e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.543845:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186680.543847:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186680.543849:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784186680.546302:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.547529:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000598132d0/0x55bc3e8c99d1a3e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.547562:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.547567:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.547576:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000598132d0/0x55bc3e8c99d1a3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.547592:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000598132d0/0x55bc3e8c99d1a3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.547624:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000598132d0/0x55bc3e8c99d1a3e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.547632:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000598132d0/0x55bc3e8c99d1a3e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.547677:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784186680.547696:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186680.547703:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000598132d0/0x55bc3e8c99d1a3e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.547711:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504c00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186680.547827:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000598132d0/0x55bc3e8c99d1a3e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.547838:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000598132d0/0x55bc3e8c99d1a3e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.547859:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000598132d0/0x55bc3e8c99d1a3e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.547868:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000598132d0/0x55bc3e8c99d1a3e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.547894:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.547901:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.547904:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784186680.551155:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.551174:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecc08714/0x55bc3e8c99d1a3ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551193:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.551198:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.551205:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc08714/0x55bc3e8c99d1a3ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551219:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecc08714/0x55bc3e8c99d1a3ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551231:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecc08714/0x55bc3e8c99d1a3ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551238:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecc08714/0x55bc3e8c99d1a3ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551260:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784186680.551868:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.551876:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d1a3f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551886:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.551890:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.551894:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d1a3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551912:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d1a3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551919:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d1a3f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551926:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d1a3f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551945:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784186680.551962:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784186680.551968:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecc08714/0x55bc3e8c99d1a3ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551975:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda505400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186680.551979:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc08714/0x55bc3e8c99d1a3ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.551988:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecc08714/0x55bc3e8c99d1a3ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.552004:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecc08714/0x55bc3e8c99d1a3ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.552011:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecc08714/0x55bc3e8c99d1a3ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.552039:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186680.552042:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d1a3f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.552048:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504800 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186680.552051:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d1a3f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.552059:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d1a3f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.552069:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d1a3f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.552075:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000855695a6/0x55bc3e8c99d1a3f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.552086:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.552087:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.552089:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784186680.556878:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.556895:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a3fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.556915:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.556929:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.556937:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a3fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.556952:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a3fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.556964:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a3fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.556971:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a3fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.556994:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784186680.557007:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186680.557012:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a3fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.557019:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186680.557023:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a3fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.557031:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a3fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.557046:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a3fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.557063:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a3fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.557081:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.557083:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.557084:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784186680.559945:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.559958:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a404 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.559976:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.559980:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.559987:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a404 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.560003:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a404 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.560013:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a404 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.560021:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a404 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.560041:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784186680.560056:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784186680.560074:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a404 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.560080:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031a00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186680.560085:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a404 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.560094:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a404 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.560111:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a404 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.560118:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a404 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.560139:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.560140:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.560142:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186680.560456:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784186680.569294:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.569312:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a40b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.571650:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.571656:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.571666:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a40b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.571703:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a40b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.571726:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a40b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.571734:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a40b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.571762:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784186680.572480:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186680.572491:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a40b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.572501:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186680.572505:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a40b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.572515:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a40b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.572535:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a40b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.572543:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001c2e26f/0x55bc3e8c99d1a40b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.572561:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186680.572563:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186680.572573:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784186680.574713:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.574729:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a412 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.574747:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.574752:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.574759:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a412 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.574772:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a412 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.574782:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a412 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.574799:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a412 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.574818:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784186680.575419:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.575426:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5099e10/0x55bc3e8c99d1a419 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.575436:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.575468:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.575473:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5099e10/0x55bc3e8c99d1a419 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.575483:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5099e10/0x55bc3e8c99d1a419 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.575490:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5099e10/0x55bc3e8c99d1a419 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.575497:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5099e10/0x55bc3e8c99d1a419 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.575513:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784186680.576016:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784186680.576026:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a412 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.576037:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031a00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.576042:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a412 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.576050:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a412 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.576071:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a412 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.576090:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007440babe/0x55bc3e8c99d1a412 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.576110:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186680.576113:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5099e10/0x55bc3e8c99d1a419 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.576119:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc0031e00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.576122:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5099e10/0x55bc3e8c99d1a419 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.576129:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5099e10/0x55bc3e8c99d1a419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.576139:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5099e10/0x55bc3e8c99d1a419 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.576146:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5099e10/0x55bc3e8c99d1a419 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.576158:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.576160:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.576162:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.576169:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784186680.579834:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.579849:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdb24471/0x55bc3e8c99d1a420 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.579876:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.579882:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.579889:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdb24471/0x55bc3e8c99d1a420 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.579905:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdb24471/0x55bc3e8c99d1a420 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.579916:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdb24471/0x55bc3e8c99d1a420 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.579926:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdb24471/0x55bc3e8c99d1a420 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.579992:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784186680.580619:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.580627:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a427 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.580646:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.580651:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.580656:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a427 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.580666:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a427 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.580689:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a427 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.580697:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a427 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.588689:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784186680.588708:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdb24471/0x55bc3e8c99d1a420 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.588741:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16c00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.588746:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdb24471/0x55bc3e8c99d1a420 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.588757:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdb24471/0x55bc3e8c99d1a420 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.588781:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdb24471/0x55bc3e8c99d1a420 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.588790:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdb24471/0x55bc3e8c99d1a420 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.588809:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186680.588813:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a427 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.588818:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.588822:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a427 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.588828:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a427 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.588837:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a427 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.588850:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.588851:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.588853:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.600476:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784186680.600494:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a427 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784186680.601241:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.601250:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0800c78/0x55bc3e8c99d1a42e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.601264:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.601269:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.601275:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0800c78/0x55bc3e8c99d1a42e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.601289:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0800c78/0x55bc3e8c99d1a42e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.601300:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0800c78/0x55bc3e8c99d1a42e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.601807:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0800c78/0x55bc3e8c99d1a42e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.601833:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784186680.602303:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.602310:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a435 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.603183:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186680.603192:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0800c78/0x55bc3e8c99d1a42e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.603203:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16800 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.603207:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0800c78/0x55bc3e8c99d1a42e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.603217:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0800c78/0x55bc3e8c99d1a42e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.603238:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0800c78/0x55bc3e8c99d1a42e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.603245:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0800c78/0x55bc3e8c99d1a42e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.603262:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.603264:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.603266:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.603272:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.605034:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.605040:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.605050:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a435 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.605069:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a435 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.605082:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a435 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.605091:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a435 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.605110:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784186680.606018:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.606027:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd812b8/0x55bc3e8c99d1a43c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.606044:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.606048:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.606054:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cd812b8/0x55bc3e8c99d1a43c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.606066:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cd812b8/0x55bc3e8c99d1a43c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.606075:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd812b8/0x55bc3e8c99d1a43c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.606082:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cd812b8/0x55bc3e8c99d1a43c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.606101:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784186680.606557:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.606563:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fa9998a/0x55bc3e8c99d1a443 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.606573:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.606576:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.606581:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fa9998a/0x55bc3e8c99d1a443 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.606591:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fa9998a/0x55bc3e8c99d1a443 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.606612:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fa9998a/0x55bc3e8c99d1a443 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.606620:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fa9998a/0x55bc3e8c99d1a443 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.606628:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784186680.607173:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784186680.607182:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a435 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607198:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17a00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.607203:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a435 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607213:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a435 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607230:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a435 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607237:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a435 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607256:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784186680.607260:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cd812b8/0x55bc3e8c99d1a43c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607266:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.607269:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd812b8/0x55bc3e8c99d1a43c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607276:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd812b8/0x55bc3e8c99d1a43c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607286:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cd812b8/0x55bc3e8c99d1a43c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607299:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cd812b8/0x55bc3e8c99d1a43c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607325:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186680.607328:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fa9998a/0x55bc3e8c99d1a443 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607335:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.607338:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fa9998a/0x55bc3e8c99d1a443 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607347:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fa9998a/0x55bc3e8c99d1a443 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607357:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fa9998a/0x55bc3e8c99d1a443 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607364:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fa9998a/0x55bc3e8c99d1a443 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.607377:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.607378:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.607380:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.607387:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784186680.615138:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1784186680.615883:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.615895:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a44a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.615913:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.615919:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.615925:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a44a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.615940:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a44a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.615951:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a44a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.615960:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a44a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.615996:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784186680.616539:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186680.616548:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a44a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.616564:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.616569:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a44a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.616579:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a44a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.616597:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a44a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.616605:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000301cd53c/0x55bc3e8c99d1a44a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.616645:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.616647:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.616649:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784186680.630183:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.630199:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a451 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.630218:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.630223:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.630230:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a451 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.630245:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a451 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.630256:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a451 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.630265:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a451 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.630282:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784186680.630406:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186680.630416:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a451 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.630425:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.630430:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a451 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.630463:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a451 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.630491:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a451 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.630499:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a451 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.630519:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.630521:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.630523:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784186680.632576:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1784186680.633537:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.633555:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b183c819/0x55bc3e8c99d1a458 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.633574:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.633586:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.633593:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b183c819/0x55bc3e8c99d1a458 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.633609:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b183c819/0x55bc3e8c99d1a458 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.634561:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b183c819/0x55bc3e8c99d1a458 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.634574:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b183c819/0x55bc3e8c99d1a458 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.635066:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784186680.638025:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.638043:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939f2d08/0x55bc3e8c99d1a45f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.638063:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.638068:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.638075:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000939f2d08/0x55bc3e8c99d1a45f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.638091:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000939f2d08/0x55bc3e8c99d1a45f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.638101:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000939f2d08/0x55bc3e8c99d1a45f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.638117:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000939f2d08/0x55bc3e8c99d1a45f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.640181:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784186680.640198:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b183c819/0x55bc3e8c99d1a458 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.640213:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16a00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.640218:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b183c819/0x55bc3e8c99d1a458 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.640228:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b183c819/0x55bc3e8c99d1a458 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.640249:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b183c819/0x55bc3e8c99d1a458 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.640266:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b183c819/0x55bc3e8c99d1a458 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.640338:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186680.640343:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000939f2d08/0x55bc3e8c99d1a45f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.640350:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17c00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.640353:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000939f2d08/0x55bc3e8c99d1a45f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.640361:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000939f2d08/0x55bc3e8c99d1a45f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.640373:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000939f2d08/0x55bc3e8c99d1a45f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.640380:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.640381:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.640384:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.641219:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784186680.641228:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000939f2d08/0x55bc3e8c99d1a45f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784186680.642221:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.642231:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca53a595/0x55bc3e8c99d1a466 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.642244:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.642248:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.642254:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca53a595/0x55bc3e8c99d1a466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.642372:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca53a595/0x55bc3e8c99d1a466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.642383:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca53a595/0x55bc3e8c99d1a466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.642391:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca53a595/0x55bc3e8c99d1a466 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.642560:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784186680.643066:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.643073:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088b92841/0x55bc3e8c99d1a46d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.643084:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.643088:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.643092:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088b92841/0x55bc3e8c99d1a46d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.643102:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088b92841/0x55bc3e8c99d1a46d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.643110:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088b92841/0x55bc3e8c99d1a46d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.643118:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088b92841/0x55bc3e8c99d1a46d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.649092:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784186680.649111:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca53a595/0x55bc3e8c99d1a466 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.649131:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17e00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186680.649137:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca53a595/0x55bc3e8c99d1a466 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.649149:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca53a595/0x55bc3e8c99d1a466 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.649175:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca53a595/0x55bc3e8c99d1a466 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.649183:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca53a595/0x55bc3e8c99d1a466 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.649211:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186680.649215:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088b92841/0x55bc3e8c99d1a46d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.649221:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17800 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186680.649223:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088b92841/0x55bc3e8c99d1a46d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.649230:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088b92841/0x55bc3e8c99d1a46d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.649266:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088b92841/0x55bc3e8c99d1a46d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.649276:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186680.649278:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186680.649280:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.651731:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784186680.656470:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784186680.656487:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088b92841/0x55bc3e8c99d1a46d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784186680.657247:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.657256:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063f83792/0x55bc3e8c99d1a474 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.657288:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.657293:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.657301:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063f83792/0x55bc3e8c99d1a474 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.657325:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063f83792/0x55bc3e8c99d1a474 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.657335:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063f83792/0x55bc3e8c99d1a474 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.657343:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063f83792/0x55bc3e8c99d1a474 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.657367:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784186680.657843:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.657849:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2e38ff1/0x55bc3e8c99d1a47b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.657857:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.657861:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.657865:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2e38ff1/0x55bc3e8c99d1a47b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.657874:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2e38ff1/0x55bc3e8c99d1a47b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.657893:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2e38ff1/0x55bc3e8c99d1a47b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.657901:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2e38ff1/0x55bc3e8c99d1a47b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.657909:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1784186680.658297:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.658303:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000090667be/0x55bc3e8c99d1a482 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.658312:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.658315:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.658319:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000090667be/0x55bc3e8c99d1a482 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.658329:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000090667be/0x55bc3e8c99d1a482 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.658336:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000090667be/0x55bc3e8c99d1a482 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.658343:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000090667be/0x55bc3e8c99d1a482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.658363:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1784186680.658816:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.658823:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a489 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.658832:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.658835:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.658840:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a489 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.658849:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a489 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.658856:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a489 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.658862:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.658871:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1784186680.659284:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.659290:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee54c59/0x55bc3e8c99d1a490 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.659298:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.659307:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.659311:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aee54c59/0x55bc3e8c99d1a490 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.659320:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aee54c59/0x55bc3e8c99d1a490 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.659327:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aee54c59/0x55bc3e8c99d1a490 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.659334:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aee54c59/0x55bc3e8c99d1a490 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.659341:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1784186680.660236:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784186680.660246:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063f83792/0x55bc3e8c99d1a474 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660265:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186680.660270:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063f83792/0x55bc3e8c99d1a474 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660280:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063f83792/0x55bc3e8c99d1a474 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660300:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063f83792/0x55bc3e8c99d1a474 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660309:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063f83792/0x55bc3e8c99d1a474 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660340:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1784186680.660343:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2e38ff1/0x55bc3e8c99d1a47b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660364:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186680.660368:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2e38ff1/0x55bc3e8c99d1a47b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660375:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2e38ff1/0x55bc3e8c99d1a47b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660385:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2e38ff1/0x55bc3e8c99d1a47b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660392:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2e38ff1/0x55bc3e8c99d1a47b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660408:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784186680.660412:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000090667be/0x55bc3e8c99d1a482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660418:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186680.660421:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000090667be/0x55bc3e8c99d1a482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660428:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000090667be/0x55bc3e8c99d1a482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660437:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000090667be/0x55bc3e8c99d1a482 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660470:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000090667be/0x55bc3e8c99d1a482 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660484:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784186680.660487:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660494:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186680.660497:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a489 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660504:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a489 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660515:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a489 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660522:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a489 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660535:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784186680.660539:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aee54c59/0x55bc3e8c99d1a490 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660544:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16e00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186680.660553:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee54c59/0x55bc3e8c99d1a490 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660561:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aee54c59/0x55bc3e8c99d1a490 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660571:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aee54c59/0x55bc3e8c99d1a490 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660578:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aee54c59/0x55bc3e8c99d1a490 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186680.660592:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186680.660594:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186680.660596:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186680.660891:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784186680.667074:0:14848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784186680.667091:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a497 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.667109:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1784186680.667114:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186680.667120:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a497 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.667133:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a497 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.667142:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a497 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.667155:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a497 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186680.667182:0:14848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784186680.667471:0:14201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784186680.667481:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a497 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.667489:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186680.667494:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a497 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.667517:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a497 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.667538:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a497 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.667545:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012af4d5f/0x55bc3e8c99d1a497 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186680.667567:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.667569:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784186680.667571:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784186680.668079:0:14848:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1784186680.668193:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14237:x1870854938004736:12345-0@lo:5:osp-pre-1-0.0 Request processed in 145147us (145210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186680.668205:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784186680.668392:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14237:1870854938004736:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784186680.668412:0:14237:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1784186680.668773:0:14237:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14237:1870854938004864:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784186680.668826:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186680.668874:0:14237:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd13fe180 going to sleep for 11 seconds 00000100:00100000:2.0:1784186680.669070:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938004864 00000100:00100000:2.0:1784186680.669078:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938004864 00000100:00100000:2.0:1784186680.669129:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784186680.669138:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14237:x1870854938004864:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1784186680.669184:0:14847:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1784186680.684315:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14237:x1870854938004864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15164us (15476us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1784186680.684334:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784186680.684972:0:14237:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14237:1870854938004864:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784186680.684992:0:14237:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1784186681.106158:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186682.116723:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784186682.494240:0:14246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1784186682.587234:0:15868:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg131-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784186683.135377:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186684.157748:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186685.120868:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938004992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784186685.120940:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186685.121019:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938004992 00000100:00100000:0.0:1784186685.121027:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938004992 00000100:00100000:0.0:1784186685.121081:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784186685.121089:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854938004992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784186685.121125:0:14849:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186685.121168:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854938004992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186685.121176:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1784186685.121196:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784186685.121232:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938004992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784186685.182613:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186685.184012:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186685.184545:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915990272 00000100:00100000:2.0:1784186685.184556:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915990272 00000100:00100000:2.0:1784186685.184614:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 75 00000100:00100000:2.0:1784186685.184624:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec4201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2353:x1870854915990272:12345-192.168.201.31@tcp:250:mount.lustre.0 00010000:00080000:2.0:1784186685.184662:0:14205:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from a817dd11-5739-48aa-94ad-59c5eb22f761@192.168.201.31@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1784186685.184695:0:14205:0:(genops.c:1406:class_connect()) connect: client a817dd11-5739-48aa-94ad-59c5eb22f761, cookie 0x55bc3e8c99d1a49e 00000100:00080000:2.0:1784186685.184837:0:14205:0:(import.c:65:import_set_state_nolock()) ffff9b9ffe377000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784186685.184918:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec4201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a817dd11-5739-48aa-94ad-59c5eb22f761+5:2353:x1870854915990272:12345-192.168.201.31@tcp:250:mount.lustre.0 Request processed in 294us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186685.184943:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 75 00000100:00100000:1.0:1784186685.210380:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186685.210470:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915990400 00000100:00100000:3.0:1784186685.210480:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915990400 00000100:00100000:3.0:1784186685.210540:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 76 00000100:00100000:3.0:1784186685.210552:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+5:13703:x1870854915990400:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784186685.210598:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186685.210617:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d1a4a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576884 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.210646:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d1a4a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576884 expref: 6 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.210658:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf17c00/0x55bc3e8c99d1a4a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576884 expref: 6 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.210666:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17c00, rc 0) 00000100:00100000:3.0:1784186685.210740:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+6:13703:x1870854915990400:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 191us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.210748:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 76 00000100:00100000:1.0:1784186685.217143:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186685.217316:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915990528 00000100:00100000:3.0:1784186685.217326:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915990528 00000100:00100000:3.0:1784186685.217556:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:0.0:1784186685.217669:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+6:13703:x1870854915990528:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784186685.217971:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+6:13703:x1870854915990528:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 391us (1044us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784186685.217981:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 77 00000100:00100000:1.0:1784186685.221027:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186685.221154:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915990656 00000100:00100000:3.0:1784186685.221165:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915990656 00000100:00100000:3.0:1784186685.221279:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:3.0:1784186685.221292:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+6:13703:x1870854915990656:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784186685.221310:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186685.221330:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d1a4ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57688b expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.221372:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d1a4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57688b expref: 7 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.221384:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf17800/0x55bc3e8c99d1a4ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57688b expref: 7 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.221394:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17800, rc 0) 00000100:00100000:3.0:1784186685.221539:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+7:13703:x1870854915990656:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 249us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.221555:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 78 00000100:00100000:1.0:1784186685.224501:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186685.224824:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915990784 00000100:00100000:0.0:1784186685.224835:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915990784 00000100:00100000:0.0:1784186685.224947:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:0.0:1784186685.224958:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+7:13703:x1870854915990784:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784186685.225260:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+8:13703:x1870854915990784:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 303us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186685.225277:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 79 00000100:00100000:1.0:1784186685.227275:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186685.227830:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915990912 00000100:00100000:2.0:1784186685.227842:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915990912 00000100:00100000:0.0:1784186685.227899:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:0.0:1784186685.227910:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+8:13703:x1870854915990912:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784186685.228224:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+8:13703:x1870854915990912:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 314us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186685.228232:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 80 00000100:00100000:1.0:1784186685.234856:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186685.234931:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915991040 00000100:00100000:3.0:1784186685.234939:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915991040 00000100:00100000:3.0:1784186685.234985:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00100000:3.0:1784186685.234995:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+8:13721:x1870854915991040:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784186685.235306:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+8:13721:x1870854915991040:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 311us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.235312:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 81 00000100:00100000:1.0:1784186685.248890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186685.249019:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915991168 00000100:00100000:0.0:1784186685.249029:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915991168 00000100:00100000:0.0:1784186685.249094:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:0.0:1784186685.249105:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+8:13721:x1870854915991168:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784186685.250012:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+8:13721:x1870854915991168:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 902us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186685.250023:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 82 00000100:00100000:1.0:1784186685.263216:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186685.264169:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915991296 00000100:00100000:3.0:1784186685.264185:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915991296 00000100:00100000:3.0:1784186685.264256:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 83 00000100:00100000:3.0:1784186685.264267:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+8:13703:x1870854915991296:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784186685.264287:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186685.264306:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf16600/0x55bc3e8c99d1a4b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5768b5 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.264334:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf16600/0x55bc3e8c99d1a4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768b5 expref: 9 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.264343:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf16600/0x55bc3e8c99d1a4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768b5 expref: 9 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.264423:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf16600, rc 0) 00000100:00100000:3.0:1784186685.264866:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+9:13703:x1870854915991296:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 598us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.264874:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 83 00000100:00100000:1.0:1784186685.266777:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186685.266874:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915991424 00000100:00100000:0.0:1784186685.266884:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915991424 00000100:00100000:0.0:1784186685.266940:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 84 00000100:00100000:0.0:1784186685.266950:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+9:13703:x1870854915991424:12345-192.168.201.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784186685.266974:0:14207:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784186685.266995:0:14207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784186685.266999:0:14207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784186685.267002:0:14207:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784186685.267004:0:14207:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1784186685.268834:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+9:13703:x1870854915991424:12345-192.168.201.31@tcp:256:mount.lustre.0 Request processed in 1870us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186685.268847:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 84 00000100:00100000:1.0:1784186685.273639:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186685.273721:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915991552 00000100:00100000:3.0:1784186685.273730:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915991552 00000100:00100000:3.0:1784186685.273787:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 85 00000100:00100000:3.0:1784186685.273808:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+9:13703:x1870854915991552:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784186685.273828:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186685.273861:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a4ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5768bc expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.273888:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768bc expref: 10 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.273897:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768bc expref: 10 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.273904:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17400, rc 0) 00000100:00100000:3.0:1784186685.273955:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+10:13703:x1870854915991552:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 159us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.273966:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 85 00000100:00100000:1.0:1784186685.281964:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186685.282064:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915991680 00000100:00100000:0.0:1784186685.282073:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915991680 00000100:00100000:0.0:1784186685.282138:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:0.0:1784186685.282148:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+10:13703:x1870854915991680:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784186685.282505:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+10:13703:x1870854915991680:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 355us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186685.282513:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 86 00000100:00100000:0.0:1784186685.286039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186685.286132:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915991808 00000100:00100000:3.0:1784186685.286141:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915991808 00000100:00100000:3.0:1784186685.286199:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 87 00000100:00100000:3.0:1784186685.286209:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+10:13703:x1870854915991808:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784186685.286606:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+10:13703:x1870854915991808:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 397us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.286615:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 87 00000100:00100000:1.0:1784186685.293833:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186685.294742:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915991936 00000100:00100000:2.0:1784186685.294755:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915991936 00000100:00100000:2.0:1784186685.294910:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 88 00000100:00100000:2.0:1784186685.294921:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a817dd11-5739-48aa-94ad-59c5eb22f761+10:13727:x1870854915991936:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784186685.295179:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a817dd11-5739-48aa-94ad-59c5eb22f761+10:13727:x1870854915991936:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 259us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186685.295187:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 88 00000100:00100000:2.0:1784186685.300863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186685.303527:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915992064 00000100:00100000:0.0:1784186685.303745:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915992064 00000100:00100000:0.0:1784186685.303887:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 89 00000100:00100000:0.0:1784186685.303898:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+10:13727:x1870854915992064:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784186685.304175:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+10:13727:x1870854915992064:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 278us (3323us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186685.304183:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 89 00000100:00100000:0.0:1784186685.315864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186685.315978:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915992192 00000100:00100000:2.0:1784186685.315990:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915992192 00000100:00100000:2.0:1784186685.316054:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:2.0:1784186685.316063:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1870854915992192:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784186685.316098:0:14213:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 5561563b-3fe0-476e-ab26-5c9f200a5d15@192.168.201.31@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1784186685.316147:0:14213:0:(genops.c:1406:class_connect()) connect: client 5561563b-3fe0-476e-ab26-5c9f200a5d15, cookie 0x55bc3e8c99d1a4c1 00000004:00100000:2.0:1784186685.316181:0:14213:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1784186685.316187:0:14213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1784186685.344682:0:14213:0:(import.c:65:import_set_state_nolock()) ffff9b9fd0de5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784186685.344756:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:2353:x1870854915992192:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 28692us (28903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.344768:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:1.0:1784186685.346818:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186685.346877:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915992320 00000100:00100000:2.0:1784186685.346887:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915992320 00000100:00100000:1.0:1784186685.346895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186685.347043:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915992448 00000100:00100000:3.0:1784186685.347047:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915992448 00000100:00100000:3.0:1784186685.347095:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:3.0:1784186685.347105:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:13703:x1870854915992448:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784186685.347164:0:14214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784186685.347243:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:13703:x1870854915992448:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 139us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.347250:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:2.0:1784186685.347320:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:2.0:1784186685.347328:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:0:x1870854915992320:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784186685.347341:0:14212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784186685.347378:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:0:x1870854915992320:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 51us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186685.347393:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00080000:0.0:1784186685.347463:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186685.349817:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186685.349900:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915992576 00000100:00100000:3.0:1784186685.349908:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915992576 00000100:00100000:3.0:1784186685.349974:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1784186685.349982:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:13703:x1870854915992576:12345-192.168.201.31@tcp:40:mount.lustre.0 00000100:00100000:3.0:1784186685.350053:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:13703:x1870854915992576:12345-192.168.201.31@tcp:40:mount.lustre.0 Request processed in 71us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.350060:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:1.0:1784186685.352293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186685.352332:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186685.352378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186685.352484:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915992704 00000100:00100000:3.0:1784186685.352495:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915992704 00000100:00100000:3.0:1784186685.352537:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915992832 00000100:00100000:3.0:1784186685.352540:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915992832 00000100:00100000:3.0:1784186685.352569:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1784186685.352578:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1870854915992704:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784186685.352612:0:14848:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 5561563b-3fe0-476e-ab26-5c9f200a5d15@192.168.201.31@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:3.0:1784186685.352653:0:14848:0:(genops.c:1406:class_connect()) connect: client 5561563b-3fe0-476e-ab26-5c9f200a5d15, cookie 0x55bc3e8c99d1a4c8 00002000:00100000:3.0:1784186685.352662:0:14848:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5561563b-3fe0-476e-ab26-5c9f200a5d15/ffff9b9fd0de0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784186685.352671:0:14848:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784186685.352948:0:14848:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784186685.352976:0:14848:0:(import.c:65:import_set_state_nolock()) ffff9b9fd0de7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784186685.353040:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:2353:x1870854915992704:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 462us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.353065:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1784186685.353081:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:3.0:1784186685.353085:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2353:x1870854915992832:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784186685.353099:0:14848:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 5561563b-3fe0-476e-ab26-5c9f200a5d15@192.168.201.31@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:3.0:1784186685.353113:0:14848:0:(genops.c:1406:class_connect()) connect: client 5561563b-3fe0-476e-ab26-5c9f200a5d15, cookie 0x55bc3e8c99d1a4cf 00002000:00100000:3.0:1784186685.353118:0:14848:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5561563b-3fe0-476e-ab26-5c9f200a5d15/ffff9b9fd0de6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784186685.353133:0:14848:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784186685.353246:0:14848:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784186685.353261:0:14848:0:(import.c:65:import_set_state_nolock()) ffff9b9fd0de0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784186685.353289:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:2353:x1870854915992832:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 201us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.353296:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:2.0:1784186685.353731:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915992960 00000100:00100000:2.0:1784186685.353738:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915992960 00000100:00100000:2.0:1784186685.353770:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:2.0:1784186685.353778:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:13703:x1870854915992960:12345-192.168.201.31@tcp:33:mount.lustre.0 00000004:00080000:2.0:1784186685.354593:0:14215:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 754us 00000004:00200000:1.0:1784186685.375653:0:14215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1784186685.375834:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:13703:x1870854915992960:12345-192.168.201.31@tcp:33:mount.lustre.0 Request processed in 22048us (23447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186685.375851:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:1.0:1784186685.549682:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186685.549809:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915993088 00000100:00100000:3.0:1784186685.549819:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915993088 00000100:00100000:3.0:1784186685.549878:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:3.0:1784186685.549888:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:13748:x1870854915993088:12345-192.168.201.31@tcp:101:mkdir.0 00010000:00010000:3.0:1784186685.549908:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186685.549932:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a4d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5768e6 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.549995:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a4dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.550010:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a4dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.550040:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a4dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186685.550243:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784186685.550247:0:14213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186685.550338:0:14213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a4dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.550843:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a4d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768e6 expref: 8 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.550866:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a4dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768e6 expref: 7 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186685.550875:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186685.550877:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186685.550880:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17a00, rc 0) 00000100:00100000:3.0:1784186685.550951:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:13748:x1870854915993088:12345-192.168.201.31@tcp:101:mkdir.0 Request processed in 1063us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186685.550959:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:1.0:1784186685.631032:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854938005120:0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.631111:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186685.631178:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854938005632:0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.631207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186685.631235:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784186685.631241:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854938005248:0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.631267:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186685.631286:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854938005760:0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.631306:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186685.631336:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854938005376:0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.631358:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186685.631378:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186685.631383:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854938005504:0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.631700:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186685.631741:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938005120 00000100:00100000:1.0:1784186685.631749:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938005120 00000100:00100000:1.0:1784186685.631801:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784186685.631811:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:3308:x1870854938005120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.631867:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:3308:x1870854938005120:12345-0@lo:400:kworker.0 Request processed in 57us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186685.631873:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1784186685.631908:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938005632 00000100:00100000:1.0:1784186685.631911:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938005632 00000100:00100000:1.0:1784186685.631942:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938005760 00000100:00100000:1.0:1784186685.631945:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938005760 00000100:00100000:1.0:1784186685.631957:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938005504 00000100:00100000:1.0:1784186685.631960:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938005504 00000100:00100000:1.0:1784186685.631972:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784186685.631977:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854938005632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.632020:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854938005632:12345-0@lo:400:kworker.0 Request processed in 43us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186685.632027:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784186685.632040:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784186685.632046:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854938005760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.632072:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854938005760:12345-0@lo:400:kworker.0 Request processed in 27us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186685.632078:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784186685.632090:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784186685.632095:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854938005504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.632125:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854938005504:12345-0@lo:400:kworker.0 Request processed in 30us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186685.632132:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784186685.632156:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938005248 00000100:00100000:1.0:1784186685.632159:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938005248 00000100:00100000:1.0:1784186685.632179:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938005376 00000100:00100000:1.0:1784186685.632181:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938005376 00000100:00100000:1.0:1784186685.632195:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784186685.632201:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854938005248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.632229:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854938005248:12345-0@lo:400:kworker.0 Request processed in 29us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186685.632234:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784186685.632245:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784186685.632250:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854938005376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.632274:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1870854938005376:12345-0@lo:400:kworker.0 Request processed in 23us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186685.632290:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1784186685.632312:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186685.632317:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186685.632351:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854938005504:0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.632365:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854938005376:0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.632392:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854938005248:0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.632401:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854938005760:0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.632424:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854938005120:0@lo:400:kworker.0 00000100:00100000:1.0:1784186685.632433:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854938005632:0@lo:400:kworker.0 00000100:00100000:0.0:1784186685.633708:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784186685.633725:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938005888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186685.633776:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186685.634141:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938005888 00000100:00100000:0.0:1784186685.634147:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938005888 00000100:00100000:0.0:1784186685.634196:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784186685.634206:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854938005888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784186685.634235:0:14849:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186685.634284:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1870854938005888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186685.634308:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784186685.634354:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938005888:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1784186685.717346:0:7480:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1784186685.717366:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5561563b-3fe0-476e-ab26-5c9f200a5d15 00010000:00010000:0.0:1784186686.207764:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186687.231083:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186687.497041:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186687.497159:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915993216 00000100:00100000:1.0:1784186687.497169:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915993216 00000100:00100000:1.0:1784186687.497242:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:1.0:1784186687.497254:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:13800:x1870854915993216:12345-192.168.201.31@tcp:41:lfs.0 00000004:00000024:1.0:1784186687.497313:0:14214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784186687.497410:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:13800:x1870854915993216:12345-192.168.201.31@tcp:41:lfs.0 Request processed in 158us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186687.497418:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00080000:0.0:1784186687.497867:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186687.501508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186687.501638:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915993344 00000100:00100000:0.0:1784186687.501648:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915993344 00000100:00100000:0.0:1784186687.501760:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:0.0:1784186687.501772:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:13800:x1870854915993344:12345-192.168.201.31@tcp:13:lfs.0 00002000:00000024:0.0:1784186687.501812:0:14849:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186687.501900:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:13800:x1870854915993344:12345-192.168.201.31@tcp:13:lfs.0 Request processed in 129us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186687.501908:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00080000:1.0:1784186687.503727:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784186687.506610:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186687.506712:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915993472 00000100:00100000:0.0:1784186687.506722:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915993472 00000100:00100000:0.0:1784186687.506801:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:0.0:1784186687.506812:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:13800:x1870854915993472:12345-192.168.201.31@tcp:13:lfs.0 00002000:00000024:0.0:1784186687.506851:0:14849:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784186687.506956:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:13800:x1870854915993472:12345-192.168.201.31@tcp:13:lfs.0 Request processed in 146us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186687.506964:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00080000:1.0:1784186687.507219:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186687.721293:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186687.721399:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915993600 00000100:00100000:0.0:1784186687.721408:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915993600 00000100:00100000:0.0:1784186687.721576:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 91 00000100:00100000:0.0:1784186687.721586:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec42ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+10:13830:x1870854915993600:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784186687.721623:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186687.721643:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ec58faa00/0x55bc3e8c99d1a4e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5768ed expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186687.721677:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58faa00/0x55bc3e8c99d1a4e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768ed expref: 11 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186687.721689:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ec58faa00/0x55bc3e8c99d1a4e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768ed expref: 11 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186687.721699:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58faa00, rc 0) 00000100:00100000:0.0:1784186687.721763:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec42ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+11:13830:x1870854915993600:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 178us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186687.721771:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 91 00000100:00100000:3.0:1784186687.726174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186687.726411:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915993728 00000100:00100000:1.0:1784186687.726434:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915993728 00000100:00100000:1.0:1784186687.726547:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00100000:1.0:1784186687.726558:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+11:13830:x1870854915993728:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784186687.726920:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+11:13830:x1870854915993728:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 363us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186687.726938:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 92 00000100:00100000:3.0:1784186687.734496:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186687.734755:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915993856 00000100:00100000:0.0:1784186687.734773:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915993856 00000100:00100000:0.0:1784186687.734831:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 93 00000100:00100000:0.0:1784186687.734841:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+11:13830:x1870854915993856:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784186687.735177:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe895c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+11:13830:x1870854915993856:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 335us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186687.735186:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 93 00000100:00100000:3.0:1784186687.746224:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186687.746415:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915993984 00000100:00100000:2.0:1784186687.746425:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915993984 00000100:00100000:2.0:1784186687.746514:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00100000:2.0:1784186687.746533:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe895850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a817dd11-5739-48aa-94ad-59c5eb22f761+11:13835:x1870854915993984:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784186687.746907:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe895850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a817dd11-5739-48aa-94ad-59c5eb22f761+11:13835:x1870854915993984:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 374us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186687.746915:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 94 00000100:00100000:3.0:1784186687.779794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186687.780126:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915994112 00000100:00100000:1.0:1784186687.780134:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915994112 00000100:00100000:1.0:1784186687.780182:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 95 00000100:00100000:1.0:1784186687.780192:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe897c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+11:13835:x1870854915994112:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784186687.780987:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe897c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+11:13835:x1870854915994112:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 794us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186687.780995:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 95 00000100:00100000:3.0:1784186687.785556:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186687.785686:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915994240 00000100:00100000:0.0:1784186687.785695:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915994240 00000100:00100000:0.0:1784186687.785767:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 96 00000100:00100000:0.0:1784186687.785778:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+11:13830:x1870854915994240:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784186687.785797:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186687.785831:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ec58fa800/0x55bc3e8c99d1a4eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576917 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186687.785859:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58fa800/0x55bc3e8c99d1a4eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576917 expref: 12 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186687.785871:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ec58fa800/0x55bc3e8c99d1a4eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576917 expref: 12 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186687.785880:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fa800, rc 0) 00000100:00100000:0.0:1784186687.785944:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe894850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+12:13830:x1870854915994240:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 168us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186687.785952:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 96 00000100:00100000:3.0:1784186687.802186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186687.806795:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915994368 00000100:00100000:1.0:1784186687.806812:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915994368 00000100:00100000:1.0:1784186687.806892:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 97 00000100:00100000:1.0:1784186687.806902:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+12:13830:x1870854915994368:12345-192.168.201.31@tcp:256:mount.lustre.0 20000000:01000000:1.0:1784186687.806931:0:14206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784186687.806957:0:14206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784186687.806961:0:14206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784186687.806963:0:14206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784186687.806965:0:14206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1784186687.809203:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+12:13830:x1870854915994368:12345-192.168.201.31@tcp:256:mount.lustre.0 Request processed in 2292us (7018us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186687.809217:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 97 00000100:00100000:3.0:1784186687.813410:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186687.813960:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915994496 00000100:00100000:0.0:1784186687.813971:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915994496 00000100:00100000:0.0:1784186687.814079:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 98 00000100:00100000:0.0:1784186687.814090:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe896850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+12:13830:x1870854915994496:12345-192.168.201.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784186687.814105:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186687.814124:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a4f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57691e expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186687.814153:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a4f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57691e expref: 13 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186687.814165:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a4f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57691e expref: 13 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186687.814173:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fb600, rc 0) 00000100:00100000:0.0:1784186687.814239:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe896850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13830:x1870854915994496:12345-192.168.201.31@tcp:101:mount.lustre.0 Request processed in 151us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186687.814261:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 98 00000100:00100000:3.0:1784186687.819698:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186687.819816:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915994624 00000100:00100000:1.0:1784186687.819839:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915994624 00000100:00100000:1.0:1784186687.819897:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 99 00000100:00100000:1.0:1784186687.819906:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe896c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13830:x1870854915994624:12345-192.168.201.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784186687.820191:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe896c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13830:x1870854915994624:12345-192.168.201.31@tcp:501:mount.lustre.0 Request processed in 285us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186687.820199:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 99 00000100:00100000:3.0:1784186687.822770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186687.823156:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915994752 00000100:00100000:0.0:1784186687.823166:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915994752 00000100:00100000:0.0:1784186687.823227:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 100 00000100:00100000:0.0:1784186687.823237:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13830:x1870854915994752:12345-192.168.201.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784186687.823817:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13830:x1870854915994752:12345-192.168.201.31@tcp:503:mount.lustre.0 Request processed in 578us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186687.823826:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 100 00000100:00100000:3.0:1784186687.828232:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186687.828341:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915994880 00000100:00100000:2.0:1784186687.828350:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915994880 00000100:00100000:2.0:1784186687.828415:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:2.0:1784186687.828426:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13844:x1870854915994880:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784186687.828788:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe897450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13844:x1870854915994880:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 363us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186687.828798:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 101 00000100:00100000:3.0:1784186687.833812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186687.834073:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915995008 00000100:00100000:0.0:1784186687.834083:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915995008 00000100:00100000:0.0:1784186687.834142:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:0.0:1784186687.834152:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13844:x1870854915995008:12345-192.168.201.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784186687.834379:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe895050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13844:x1870854915995008:12345-192.168.201.31@tcp:502:llog_process_th.0 Request processed in 227us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186687.834388:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 102 00000100:00100000:3.0:1784186687.853534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186687.853618:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915995136 00000100:00100000:1.0:1784186687.853630:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915995136 00000100:00100000:1.0:1784186687.853692:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:1.0:1784186687.853701:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1870854915995136:12345-192.168.201.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784186687.853736:0:14213:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2758468b-7a8c-4a51-b99e-f874fcc4fd95@192.168.201.31@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:1.0:1784186687.853774:0:14213:0:(genops.c:1406:class_connect()) connect: client 2758468b-7a8c-4a51-b99e-f874fcc4fd95, cookie 0x55bc3e8c99d1a4f9 00000004:00100000:1.0:1784186687.853808:0:14213:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784186687.854098:0:14213:0:(import.c:65:import_set_state_nolock()) ffff9b9ec5bdd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784186687.854211:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:2353:x1870854915995136:12345-192.168.201.31@tcp:38:mount.lustre.0 Request processed in 509us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186687.854220:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:3.0:1784186687.865469:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186687.866966:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915995264 00000100:00100000:2.0:1784186687.866980:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915995264 00000100:00100000:2.0:1784186687.867104:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:2.0:1784186687.867117:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:0:x1870854915995264:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784186687.867161:0:14212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1784186687.867292:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186687.867561:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:0:x1870854915995264:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 444us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186687.867572:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:3.0:1784186687.875527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186687.875703:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915995392 00000100:00100000:1.0:1784186687.875714:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915995392 00000100:00100000:1.0:1784186687.875775:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:1.0:1784186687.875785:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:13830:x1870854915995392:12345-192.168.201.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784186687.875819:0:14213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784186687.875912:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:13830:x1870854915995392:12345-192.168.201.31@tcp:41:mount.lustre.0 Request processed in 128us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186687.875921:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:1.0:1784186687.880734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186687.881135:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915995520 00000100:00100000:3.0:1784186687.881145:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915995520 00000100:00100000:3.0:1784186687.881204:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:3.0:1784186687.881213:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:13830:x1870854915995520:12345-192.168.201.31@tcp:40:mount.lustre.0 00000100:00100000:3.0:1784186687.881310:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:13830:x1870854915995520:12345-192.168.201.31@tcp:40:mount.lustre.0 Request processed in 98us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186687.881317:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:3.0:1784186687.892549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186687.892667:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915995648 00000100:00100000:1.0:1784186687.892680:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915995648 00000100:00100000:1.0:1784186687.892734:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:1.0:1784186687.892743:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1870854915995648:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784186687.892776:0:14847:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2758468b-7a8c-4a51-b99e-f874fcc4fd95@192.168.201.31@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:1.0:1784186687.892814:0:14847:0:(genops.c:1406:class_connect()) connect: client 2758468b-7a8c-4a51-b99e-f874fcc4fd95, cookie 0x55bc3e8c99d1a500 00002000:00100000:1.0:1784186687.892829:0:14847:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2758468b-7a8c-4a51-b99e-f874fcc4fd95/ffff9b9ec5bdd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784186687.892840:0:14847:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784186687.892971:0:14847:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784186687.893004:0:14847:0:(import.c:65:import_set_state_nolock()) ffff9b9ec5bde000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784186687.893088:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:2353:x1870854915995648:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 344us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186687.893096:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:1.0:1784186687.897680:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186687.898141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186687.898240:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915995904 00000100:00100000:0.0:1784186687.898251:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915995904 00000100:00100000:0.0:1784186687.898308:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:0.0:1784186687.898320:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:13830:x1870854915995904:12345-192.168.201.31@tcp:33:mount.lustre.0 00000004:00200000:0.0:1784186687.898976:0:14216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1784186687.899133:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:13830:x1870854915995904:12345-192.168.201.31@tcp:33:mount.lustre.0 Request processed in 813us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186687.899143:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:2.0:1784186687.903009:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915995776 00000100:00100000:2.0:1784186687.903094:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915995776 00000100:00100000:2.0:1784186687.903232:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:2.0:1784186687.903253:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1870854915995776:12345-192.168.201.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784186687.903292:0:14845:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2758468b-7a8c-4a51-b99e-f874fcc4fd95@192.168.201.31@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:2.0:1784186687.903353:0:14845:0:(genops.c:1406:class_connect()) connect: client 2758468b-7a8c-4a51-b99e-f874fcc4fd95, cookie 0x55bc3e8c99d1a507 00002000:00100000:2.0:1784186687.903366:0:14845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2758468b-7a8c-4a51-b99e-f874fcc4fd95/ffff9b9ffeeed000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784186687.903380:0:14845:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784186687.904424:0:14845:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784186687.904762:0:14845:0:(import.c:65:import_set_state_nolock()) ffff9b9ffeeec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784186687.904854:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:2353:x1870854915995776:12345-192.168.201.31@tcp:8:mount.lustre.0 Request processed in 1600us (7182us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186687.904864:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:3.0:1784186688.058725:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186688.061585:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915996032 00000100:00100000:2.0:1784186688.061601:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915996032 00000100:00100000:2.0:1784186688.061677:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1784186688.061689:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:13865:x1870854915996032:12345-192.168.201.31@tcp:101:mkdir.0 00010000:00010000:2.0:1784186688.061710:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186688.061734:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a50e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576948 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186688.061983:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186688.061998:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186688.062011:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186688.062229:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784186688.062234:0:14212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186688.063562:0:14212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186688.063605:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a50e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576948 expref: 8 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186688.065024:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576948 expref: 7 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186688.065039:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:2.0:1784186688.065042:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784186688.065045:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c000, rc 0) 00000100:00100000:2.0:1784186688.065128:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+7:13865:x1870854915996032:12345-192.168.201.31@tcp:101:mkdir.0 Request processed in 3439us (6411us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186688.065137:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000001:00100000:1.0:1784186688.246096:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2758468b-7a8c-4a51-b99e-f874fcc4fd95 00000001:00100000:1.0:1784186688.246111:0:6607:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5561563b-3fe0-476e-ab26-5c9f200a5d15 00010000:00010000:0.0:1784186688.253669:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186689.281112:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186690.237886:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938006016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784186690.237961:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186690.238124:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938006016 00000100:00100000:1.0:1784186690.238133:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938006016 00000100:00100000:1.0:1784186690.238202:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784186690.238211:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854938006016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784186690.238248:0:14849:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186690.238312:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854938006016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186690.238319:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1784186690.238395:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784186690.238468:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938006016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784186690.303270:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186690.750356:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854938006144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186690.750437:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186690.750586:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938006144 00000100:00100000:1.0:1784186690.750595:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938006144 00000100:00100000:1.0:1784186690.750655:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784186690.750666:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854938006144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784186690.750702:0:14849:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186690.750749:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1870854938006144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186690.750756:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1784186690.750803:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784186690.754131:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854938006400:0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.754213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186690.755782:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784186690.755798:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854938006528:0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.755869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186690.756834:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938006528 00000100:00100000:2.0:1784186690.756905:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938006528 00000100:00100000:2.0:1784186690.757039:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784186690.757051:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854938006528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.757129:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854938006528:12345-0@lo:400:kworker.0 Request processed in 81us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186690.757138:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784186690.757171:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3309:1870854938006272:0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.757209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186690.757242:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854938006784:0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.757265:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186690.757288:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784186690.757295:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854938006656:0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.757318:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186690.757345:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938006272 00000100:00100000:2.0:1784186690.757348:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938006272 00000100:00100000:2.0:1784186690.757377:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784186690.757383:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe896050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:3309:x1870854938006272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.757417:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe896050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:3309:x1870854938006272:12345-0@lo:400:kworker.0 Request processed in 34us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186690.757433:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784186690.757497:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938006784 00000100:00100000:2.0:1784186690.757501:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938006784 00000100:00100000:2.0:1784186690.757528:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938006656 00000100:00100000:2.0:1784186690.757531:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938006656 00000100:00100000:2.0:1784186690.757551:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784186690.757556:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854938006784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.757589:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1870854938006784:12345-0@lo:400:kworker.0 Request processed in 32us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186690.757595:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784186690.757608:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784186690.757614:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854938006656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.757641:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1870854938006656:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186690.757647:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1784186690.757667:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186690.757710:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1784186690.757735:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854938006144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784186690.757762:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1870854938006656:0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.757771:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3309:1870854938006272:0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.757780:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1870854938006784:0@lo:400:kworker.0 00000100:00100000:2.0:1784186690.757811:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854938006528:0@lo:400:kworker.0 00000100:00100000:3.0:1784186690.763186:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938006400 00000100:00100000:3.0:1784186690.763204:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938006400 00000100:00100000:3.0:1784186690.763425:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784186690.763436:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854938006400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186690.763571:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854938006400:12345-0@lo:400:kworker.0 Request processed in 137us (9358us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186690.763579:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784186690.772642:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854938006400:0@lo:400:kworker.0 00000001:00100000:0.0:1784186690.795553:0:7480:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2758468b-7a8c-4a51-b99e-f874fcc4fd95 00000001:00100000:1.0:1784186690.845291:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2758468b-7a8c-4a51-b99e-f874fcc4fd95 00000001:00100000:1.0:1784186690.845308:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5561563b-3fe0-476e-ab26-5c9f200a5d15 00000001:02000400:1.0:1784186691.006664:0:16074:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1784186691.325666:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186692.349762:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784186692.741202:0:14246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784186692.952122:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186692.952166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186692.952194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186692.952229:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186692.952247:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186692.952265:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186692.952290:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186692.952312:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915996416 00000100:00100000:1.0:1784186692.952323:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915996416 00000100:00100000:1.0:1784186692.952376:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915996928 00000100:00100000:1.0:1784186692.952380:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915996928 00000100:00100000:1.0:1784186692.952395:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915996544 00000100:00100000:1.0:1784186692.952397:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915996544 00000100:00100000:1.0:1784186692.952409:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915996800 00000100:00100000:1.0:1784186692.952412:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915996800 00000100:00100000:1.0:1784186692.952479:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:1.0:1784186692.952490:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2357:x1870854915996416:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186692.952642:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2357:x1870854915996416:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 154us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186692.952651:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:1.0:1784186692.952674:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:1.0:1784186692.952681:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2357:x1870854915996928:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186692.952709:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2357:x1870854915996928:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186692.952715:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:1.0:1784186692.952727:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1784186692.952733:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2357:x1870854915996544:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186692.952754:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2357:x1870854915996544:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 21us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186692.952761:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1784186692.952772:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:1.0:1784186692.952777:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2357:x1870854915996800:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186692.952801:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2357:x1870854915996800:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 24us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186692.952806:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:1.0:1784186692.952826:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915996672 00000100:00100000:1.0:1784186692.952830:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915996672 00000100:00100000:1.0:1784186692.952857:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915996288 00000100:00100000:1.0:1784186692.952859:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915996288 00000100:00100000:1.0:1784186692.952886:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:1.0:1784186692.952891:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:2357:x1870854915996672:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186692.952920:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:2357:x1870854915996672:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 28us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186692.952926:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:1.0:1784186692.952936:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:1.0:1784186692.952942:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fefd1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:2357:x1870854915996288:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186692.952962:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fefd1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:2357:x1870854915996288:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 20us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186692.952968:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00080000:1.0:1784186692.952994:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784186692.952999:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784186692.953001:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784186692.954769:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915996160 00000100:00100000:0.0:1784186692.954787:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915996160 00000100:00100000:0.0:1784186692.954844:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 104 00000100:00100000:0.0:1784186692.954855:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+13:2357:x1870854915996160:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186692.954933:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+13:2357:x1870854915996160:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 80us (2826us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186692.954941:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 104 00010000:00010000:0.0:1784186693.375453:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186694.397809:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784186695.009688:0:16224:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd11914400 20000000:00000080:3.0:1784186695.009713:0:16224:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b9ec7291000 uarg=0000000000000000 20000000:01000000:3.0:1784186695.009750:0:16224:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784186695.009757:0:16224:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784186695.009762:0:16224:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784186695.015182:0:16225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1784186695.015668:0:16224:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1784186695.022233:0:16224:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784186695.022268:0:16224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.022289:0:16224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc766de00/0x55bc3e8c99d1a213 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a20c expref: 18 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.022297:0:16224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fc766c400/0x55bc3e8c99d1a260 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a259 expref: 18 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.022304:0:16224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a39b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a394 expref: 18 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.022313:0:16224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768bc expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.022321:0:16224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a4f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57691e expref: 12 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.022329:0:16224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.022738:0:16224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a4f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57691e expref: 12 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.022755:0:16224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a4f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57691e expref: 12 pid: 14207 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186695.022855:0:16224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16224:1870854938006912:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186695.023276:0:16224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768bc expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.023286:0:16224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a4ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768bc expref: 12 pid: 14206 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186695.023296:0:16224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16224:1870854938007040:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186695.023342:0:16224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a39b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d1a394 expref: 18 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.023352:0:16224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a39b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a394 expref: 18 pid: 14207 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186695.023363:0:16224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16224:1870854938007168:0@lo:104: 00000100:00100000:3.0:1784186695.023416:0:16224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784186695.023489:0:16224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc766c400/0x55bc3e8c99d1a260 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d1a259 expref: 18 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.023497:0:16224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9fc766c400/0x55bc3e8c99d1a260 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a259 expref: 18 pid: 14206 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186695.023505:0:16224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16224:1870854938007296:0@lo:104: 00000100:00100000:3.0:1784186695.023525:0:16224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784186695.023676:0:16224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b9fc766de00/0x55bc3e8c99d1a213 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x55bc3e8c99d1a20c expref: 18 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.023685:0:16224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b9fc766de00/0x55bc3e8c99d1a213 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a20c expref: 18 pid: 14205 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186695.023705:0:16224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6313800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16224:1870854938007424:0@lo:104: 00000100:00100000:3.0:1784186695.023732:0:16224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186695.023743:0:16224:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc11ca180 going to sleep for 11 seconds 00000100:00100000:1.0:1784186695.023839:0:14195:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784186695.023855:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938007168 00000100:00100000:1.0:1784186695.023863:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938007168 00000100:00100000:1.0:1784186695.023900:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938007296 00000100:00100000:1.0:1784186695.023903:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938007296 00000100:00100000:1.0:1784186695.023914:0:14195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938007424 00000100:00100000:1.0:1784186695.023917:0:14195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938007424 00000100:00100000:1.0:1784186695.023931:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784186695.023940:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+5:16224:x1870854938007168:12345-0@lo:104: 00010000:00010000:1.0:1784186695.023953:0:14195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024018:0:14195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784186695.024031:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+5:16224:x1870854938007168:12345-0@lo:104: Request processed in 93us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186695.024039:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784186695.024063:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784186695.024069:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+4:16224:x1870854938007296:12345-0@lo:104: 00010000:00010000:1.0:1784186695.024077:0:14195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024110:0:14195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784186695.024115:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+4:16224:x1870854938007296:12345-0@lo:104: Request processed in 47us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186695.024121:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784186695.024135:0:14195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784186695.024141:0:14195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ff53eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+3:16224:x1870854938007424:12345-0@lo:104: 00010000:00010000:1.0:1784186695.024149:0:14195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024174:0:14195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784186695.024179:0:14195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ff53eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+3:16224:x1870854938007424:12345-0@lo:104: Request processed in 39us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186695.024185:0:14195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1784186695.024224:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784186695.024230:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024238:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb000 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:1.0:1784186695.024242:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024261:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784186695.024269:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186695.024275:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784186695.024306:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024313:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784186695.024335:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024343:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9ec58fb000/0x55bc3e8c99d1a394 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a39b expref: -99 pid: 15513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024358:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784186695.024361:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024367:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fda504400 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:1.0:1784186695.024370:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024377:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784186695.024384:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186695.024407:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784186695.024423:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024429:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784186695.024435:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024471:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fda504400/0x55bc3e8c99d1a259 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a260 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024867:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186695.024871:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024877:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc27ece00 already unused, calling callback (ffffffffc1d84c20) 10000000:00010000:1.0:1784186695.024881:0:14200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024888:0:14200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784186695.024894:0:14200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784186695.024900:0:14200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784186695.024916:0:14200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024922:0:14200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784186695.024951:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024959:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.131@tcp lock: ffff9b9fc27ece00/0x55bc3e8c99d1a20c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x55bc3e8c99d1a213 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.024974:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186695.024977:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186695.024979:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186695.024989:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186695.025013:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3306:1870854938007552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784186695.025058:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186695.025092:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784186695.025098:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3306:1870854938007680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784186695.025120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186695.025147:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fefd1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854938007808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784186695.025170:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186695.025204:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938007552 00000100:00100000:1.0:1784186695.025209:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938007552 00010000:00010000:1.0:1784186695.025233:0:14197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a39b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a394 expref: 19 pid: 14207 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186695.025248:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938007680 00000100:00100000:1.0:1784186695.025251:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938007680 00010000:00010000:1.0:1784186695.025261:0:14197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc766c400/0x55bc3e8c99d1a260 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a259 expref: 20 pid: 14206 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186695.025271:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938007808 00000100:00100000:1.0:1784186695.025273:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938007808 00010000:00010000:1.0:1784186695.025283:0:14197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9fc766de00/0x55bc3e8c99d1a213 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a20c expref: 21 pid: 14205 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186695.025306:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784186695.025312:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+21:3306:x1870854938007552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784186695.025326:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186695.025331:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a39b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a394 expref: 21 pid: 14207 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.025341:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a39b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a394 expref: 21 pid: 14207 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.025358:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186695.025388:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+21:3306:x1870854938007552:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186695.025405:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784186695.025423:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784186695.025429:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+20:3306:x1870854938007680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784186695.025435:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186695.025467:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc766c400/0x55bc3e8c99d1a260 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a259 expref: 20 pid: 14206 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.025869:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc766c400/0x55bc3e8c99d1a260 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a259 expref: 20 pid: 14206 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.025883:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186695.025910:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+20:3306:x1870854938007680:12345-0@lo:103:ldlm_bl.0 Request processed in 482us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186695.025917:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784186695.025930:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784186695.025941:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe03b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:3308:x1870854938007808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784186695.025949:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186695.025953:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9fc766de00/0x55bc3e8c99d1a213 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a20c expref: 19 pid: 14205 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.025961:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9fc766de00/0x55bc3e8c99d1a213 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x55bc3e8c99d1a20c expref: 19 pid: 14205 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186695.025970:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186695.026009:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe03b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:3308:x1870854938007808:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186695.026016:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784186695.026084:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3306:1870854938007680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784186695.026093:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3306:1870854938007552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784186695.026236:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fefd1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3308:1870854938007808:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784186695.026366:0:16224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fda505a00/0x55bc3e8c99d1a39b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d1a394 expref: 18 pid: 14207 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186695.026379:0:16224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16224:1870854938007168:0@lo:104: 00010000:00010000:3.0:1784186695.026390:0:16224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc766c400/0x55bc3e8c99d1a260 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d1a259 expref: 17 pid: 14206 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186695.026406:0:16224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16224:1870854938007296:0@lo:104: 00010000:00010000:3.0:1784186695.026416:0:16224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9fc766de00/0x55bc3e8c99d1a213 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x55bc3e8c99d1a20c expref: 16 pid: 14205 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186695.026425:0:16224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6313800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16224:1870854938007424:0@lo:104: 00000100:00100000:3.0:1784186695.029609:0:16224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16224:1870854938006912:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186695.029626:0:16224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16224:1870854938007040:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186695.029668:0:16224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186695.030745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186695.032287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186695.032364:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915997056 00000100:00100000:3.0:1784186695.032383:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915997056 00010000:00010000:3.0:1784186695.032428:0:14199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a4f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57691e expref: 13 pid: 14207 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186695.032484:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915997184 00000100:00100000:3.0:1784186695.032487:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915997184 00010000:00010000:3.0:1784186695.032504:0:14199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a4ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768bc expref: 14 pid: 14206 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186695.032519:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1784186695.032526:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a817dd11-5739-48aa-94ad-59c5eb22f761+14:2356:x1870854915997056:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186695.032541:0:14199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186695.032547:0:14199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a4f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57691e expref: 14 pid: 14207 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032568:0:14199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a4f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57691e expref: 14 pid: 14207 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032588:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ec58fb600/0x55bc3e8c99d1a4f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57691e expref: 14 pid: 14207 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032605:0:14199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186695.032620:0:14198:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1784186695.032630:0:14198:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1784186695.032666:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a817dd11-5739-48aa-94ad-59c5eb22f761+13:2356:x1870854915997056:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 139us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186695.032674:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1784186695.032692:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:3.0:1784186695.032698:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a817dd11-5739-48aa-94ad-59c5eb22f761+12:2357:x1870854915997184:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186695.032705:0:14199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186695.032709:0:14199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a4ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768bc expref: 12 pid: 14206 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032719:0:14199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768bc expref: 12 pid: 14206 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032914:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a4ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768bc expref: 12 pid: 14206 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032926:0:14199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032934:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032949:0:14199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032956:0:14199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032963:0:14199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032969:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032975:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186695.032979:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.032987:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.033006:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186695.033025:0:14199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186695.033049:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a817dd11-5739-48aa-94ad-59c5eb22f761+11:2357:x1870854915997184:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 351us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186695.033056:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00010000:00010000:2.0:1784186695.033427:0:16224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186695.033436:0:16224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186695.033463:0:16224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b9ffdf17600/0x55bc3e8c99d1a51c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186695.357963:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854938007936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186695.358040:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186695.358193:0:14849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938007936 00000100:00100000:3.0:1784186695.358202:0:14849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938007936 00000100:00100000:3.0:1784186695.358279:0:14849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784186695.358288:0:14849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854938007936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784186695.358336:0:14849:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1784186695.358464:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784186695.368909:0:14849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854938007936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10611us (10858us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186695.368924:0:14849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784186695.371096:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854938007936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784186695.421797:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186695.875714:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854938008064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784186695.875799:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186695.875888:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938008064 00000100:00100000:1.0:1784186695.875897:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938008064 00000100:00100000:1.0:1784186695.875964:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784186695.875974:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854938008064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784186695.876005:0:14850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784186695.876049:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854938008064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186695.876074:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784186695.876128:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854938008064:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784186695.879045:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784186695.879252:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6313100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854938008320:0@lo:400:kworker.0 00000100:00100000:3.0:1784186695.879324:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186695.879360:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784186695.879366:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854938008448:0@lo:400:kworker.0 00000100:00100000:3.0:1784186695.879399:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186695.879426:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938008320 00000100:00100000:3.0:1784186695.879433:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938008320 00000100:00100000:3.0:1784186695.879499:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938008448 00000100:00100000:3.0:1784186695.879502:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938008448 00000100:00100000:3.0:1784186695.879528:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784186695.879537:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854938008320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186695.879590:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1870854938008320:12345-0@lo:400:kworker.0 Request processed in 53us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186695.879598:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784186695.879631:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784186695.879636:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854938008448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186695.879661:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1870854938008448:12345-0@lo:400:kworker.0 Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186695.879666:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1784186695.879686:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186695.879695:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3307:1870854938008192:0@lo:400:kworker.0 00000100:00100000:3.0:1784186695.879721:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186695.879747:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784186695.879752:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854938008576:0@lo:400:kworker.0 00000100:00100000:3.0:1784186695.879775:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186695.879797:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938008192 00000100:00100000:3.0:1784186695.879801:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938008192 00000100:00100000:3.0:1784186695.879829:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784186695.879836:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:3307:x1870854938008192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186695.879872:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:3307:x1870854938008192:12345-0@lo:400:kworker.0 Request processed in 36us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186695.879878:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784186695.879932:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1870854938008448:0@lo:400:kworker.0 00000100:00100000:3.0:1784186695.879944:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6313100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854938008320:0@lo:400:kworker.0 00000100:00100000:3.0:1784186695.879969:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3307:1870854938008192:0@lo:400:kworker.0 00000100:00100000:3.0:1784186695.879981:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938008576 00000100:00100000:3.0:1784186695.879984:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938008576 00000100:00100000:3.0:1784186695.880008:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784186695.880015:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1870854938008576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186695.880050:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1870854938008576:12345-0@lo:400:kworker.0 Request processed in 35us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186695.880055:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1784186695.880070:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186695.880085:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1870854938008576:0@lo:400:kworker.0 00000100:00100000:2.0:1784186696.406918:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186696.409502:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915997312 00000100:00100000:0.0:1784186696.409519:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915997312 00000100:00100000:0.0:1784186696.409592:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 106 00000100:00100000:0.0:1784186696.409604:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe897850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+11:13717:x1870854915997312:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186696.409624:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186696.409646:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ec58fb400/0x55bc3e8c99d1a523 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57694f expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186696.409675:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58fb400/0x55bc3e8c99d1a523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57694f expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186696.409700:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ec58fb400/0x55bc3e8c99d1a523 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57694f expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186696.409711:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fb400, rc 0) 00000100:00100000:0.0:1784186696.409783:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe897850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+12:13717:x1870854915997312:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 181us (2874us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186696.409791:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 106 00000100:00100000:0.0:1784186696.414216:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186696.414551:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915997440 00000100:00100000:3.0:1784186696.414561:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915997440 00000100:00100000:3.0:1784186696.414614:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00100000:3.0:1784186696.414623:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+12:13717:x1870854915997440:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186696.414932:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+12:13717:x1870854915997440:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 310us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186696.414941:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 107 00000100:00100000:1.0:1784186696.419177:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186696.419472:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915997568 00000100:00100000:3.0:1784186696.419483:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915997568 00000100:00100000:3.0:1784186696.419545:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 108 00000100:00100000:3.0:1784186696.419556:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a817dd11-5739-48aa-94ad-59c5eb22f761+12:13717:x1870854915997568:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186696.419841:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a817dd11-5739-48aa-94ad-59c5eb22f761+12:13717:x1870854915997568:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 286us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186696.419851:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 108 00000100:00100000:2.0:1784186696.443652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186696.448817:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915997696 00000100:00100000:0.0:1784186696.448832:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915997696 00000100:00100000:0.0:1784186696.448893:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 109 00000100:00100000:0.0:1784186696.448904:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+12:13717:x1870854915997696:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186696.448921:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186696.448942:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ec58fb800/0x55bc3e8c99d1a52a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576956 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186696.448972:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58fb800/0x55bc3e8c99d1a52a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576956 expref: 13 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186696.448982:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ec58fb800/0x55bc3e8c99d1a52a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576956 expref: 13 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186696.448988:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fb800, rc 0) 00000100:00100000:0.0:1784186696.449044:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13717:x1870854915997696:12345-192.168.201.31@tcp:101:ll_cfg_requeue.0 Request processed in 142us (5403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186696.449051:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 109 00010000:00010000:0.0:1784186696.453910:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186696.458750:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186696.458916:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915997824 00000100:00100000:1.0:1784186696.458927:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915997824 00000100:00100000:1.0:1784186696.458988:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00100000:1.0:1784186696.458998:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13717:x1870854915997824:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784186696.459272:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13717:x1870854915997824:12345-192.168.201.31@tcp:501:ll_cfg_requeue.0 Request processed in 275us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186696.459281:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 110 00000100:00100000:0.0:1784186696.468270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186696.468559:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915997952 00000100:00100000:3.0:1784186696.468569:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915997952 00000100:00100000:3.0:1784186696.468615:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 111 00000100:00100000:3.0:1784186696.468624:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13717:x1870854915997952:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186696.468847:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+13:13717:x1870854915997952:12345-192.168.201.31@tcp:503:ll_cfg_requeue.0 Request processed in 223us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186696.468863:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 111 10000000:01000000:1.0:1784186696.957573:0:14209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784186696.957581:0:14209:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc8258800 from 10 10000000:01000000:1.0:1784186696.957587:0:14209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784186696.957637:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffcc5da00/0x55bc3e8c99d1a531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186696.957650:0:14209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ffcc5da00/0x55bc3e8c99d1a531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186696.957662:0:14209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ffcc5da00/0x55bc3e8c99d1a531 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186696.957687:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938008704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784186696.957755:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186696.957819:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0861000 going to sleep for 11 seconds 00000100:00100000:3.0:1784186696.957999:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938008704 00000100:00100000:3.0:1784186696.958006:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938008704 00000100:00100000:3.0:1784186696.958064:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784186696.958075:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+16:14209:x1870854938008704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784186696.958090:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186696.958102:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a538 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a531 expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186696.958127:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a531 expref: 17 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186696.958138:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf17400/0x55bc3e8c99d1a538 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a531 expref: 17 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186696.958147:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf17400, rc 0) 00000100:00100000:3.0:1784186696.958186:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:14209:x1870854938008704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186696.958194:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784186696.958515:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938008704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784186696.958545:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ffcc5da00/0x55bc3e8c99d1a531 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a538 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186696.958555:0:14209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ffcc5da00/0x55bc3e8c99d1a531 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a538 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186696.958616:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938008832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784186696.958644:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186696.958668:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0861000 going to sleep for 11 seconds 00000100:00100000:0.0:1784186696.958999:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938008832 00000100:00100000:0.0:1784186696.959004:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938008832 00000100:00100000:0.0:1784186696.959030:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1784186696.959036:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:14209:x1870854938008832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186696.959310:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:14209:x1870854938008832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186696.959318:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784186696.959840:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938008832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784186696.959877:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938008960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784186696.959924:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186696.959946:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0861000 going to sleep for 11 seconds 00000100:00100000:3.0:1784186696.960062:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938008960 00000100:00100000:3.0:1784186696.960069:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938008960 00000100:00100000:3.0:1784186696.960106:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784186696.960113:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:14209:x1870854938008960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186696.960273:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:14209:x1870854938008960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186696.960279:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784186696.962115:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938008960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784186696.967080:0:16294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1784186696.968102:0:14209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1784186696.968140:0:14209:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784186696.968153:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffcc5da00/0x55bc3e8c99d1a531 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a538 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186696.968165:0:14209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ffcc5da00/0x55bc3e8c99d1a531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a538 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784186696.968177:0:14209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784186696.968180:0:14209:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9ec4a84800 from 10 10000000:01000000:3.0:1784186696.968183:0:14209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784186696.968219:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1a53f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186696.968227:0:14209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1a53f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186696.968238:0:14209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1a53f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186696.968264:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784186696.968344:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186696.968436:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65780 going to sleep for 11 seconds 00000100:00100000:0.0:1784186696.969437:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938009088 00000100:00100000:0.0:1784186696.969459:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938009088 00000100:00100000:0.0:1784186696.969508:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1784186696.969518:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+17:14209:x1870854938009088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186696.969758:0:14205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186696.969780:0:14205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ec58fa600/0x55bc3e8c99d1a546 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a53f expref: -99 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186696.969813:0:14205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ec58fa600/0x55bc3e8c99d1a546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a53f expref: 18 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186696.969826:0:14205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ec58fa600/0x55bc3e8c99d1a546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a53f expref: 18 pid: 14205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186696.969835:0:14205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fa600, rc 0) 00000100:00100000:0.0:1784186696.969906:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:14209:x1870854938009088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 389us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186696.969914:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784186696.970588:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784186696.970607:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1a53f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a546 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186696.970618:0:14209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1a53f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a546 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186696.970682:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784186696.970727:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186696.970764:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65780 going to sleep for 11 seconds 00000100:00100000:0.0:1784186696.970947:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938009216 00000100:00100000:0.0:1784186696.970958:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938009216 00000100:00100000:0.0:1784186696.971031:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1784186696.971039:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:14209:x1870854938009216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186696.971274:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6708050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:14209:x1870854938009216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186696.971279:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1784186696.971323:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6313480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784186696.971358:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784186696.971408:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186696.971715:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0861000 going to sleep for 11 seconds 00000100:00100000:0.0:1784186696.971744:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938009344 00000100:00100000:0.0:1784186696.971748:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938009344 00000100:00100000:0.0:1784186696.971783:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784186696.971790:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:14209:x1870854938009344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186696.971932:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:14209:x1870854938009344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186696.971939:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1784186696.972272:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784186696.973425:0:16295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1784186696.973741:0:14209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1784186696.973769:0:14209:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784186696.973781:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1a53f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a546 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186696.973789:0:14209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9ffdf16800/0x55bc3e8c99d1a53f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a546 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784186696.973797:0:14209:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784186696.974335:0:14209:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9b9fc7fc5000 from 10 10000000:01000000:2.0:1784186696.974341:0:14209:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784186696.974540:0:14209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d800/0x55bc3e8c99d1a54d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186696.974550:0:14209:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d800/0x55bc3e8c99d1a54d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186696.974572:0:14209:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d800/0x55bc3e8c99d1a54d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186696.974597:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784186696.974658:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186696.974695:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc2bb9240 going to sleep for 11 seconds 00000100:00100000:3.0:1784186696.975137:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938009472 00000100:00100000:3.0:1784186696.975147:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938009472 00000100:00100000:3.0:1784186696.975196:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784186696.975206:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+18:14209:x1870854938009472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784186696.975220:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186696.975236:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b9ffdf16c00/0x55bc3e8c99d1a554 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x55bc3e8c99d1a54d expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186696.975260:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b9ffdf16c00/0x55bc3e8c99d1a554 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a54d expref: 19 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186696.975270:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b9ffdf16c00/0x55bc3e8c99d1a554 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x55bc3e8c99d1a54d expref: 19 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186696.975278:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf16c00, rc 0) 00000100:00100000:3.0:1784186696.975327:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec670b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:14209:x1870854938009472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186696.975334:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784186696.975458:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784186696.975474:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d800/0x55bc3e8c99d1a54d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a554 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186696.975483:0:14209:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d800/0x55bc3e8c99d1a54d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x55bc3e8c99d1a554 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186696.975648:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186696.975682:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186696.975712:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc12edf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186696.975876:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938009600 00000100:00100000:2.0:1784186696.975879:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938009600 00000100:00100000:2.0:1784186696.975895:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784186696.975900:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:14209:x1870854938009600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784186696.976160:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:14209:x1870854938009600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186696.976168:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784186696.976183:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784186696.976214:0:14209:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784186696.976257:0:14209:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186696.976277:0:14209:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fc12edf00 going to sleep for 11 seconds 00000100:00100000:2.0:1784186696.976394:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938009728 00000100:00100000:2.0:1784186696.976398:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938009728 00000100:00100000:3.0:1784186696.976663:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784186696.976672:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:14209:x1870854938009728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784186696.977032:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:14209:x1870854938009728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 361us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186696.977039:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1784186696.977116:0:14209:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:14209:1870854938009728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784186696.979186:0:16297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1784186696.979656:0:14209:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1784186696.979683:0:14209:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.131@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784186696.979696:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d800/0x55bc3e8c99d1a54d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a554 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186696.979714:0:14209:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.131@tcp lock: ffff9b9fc766d800/0x55bc3e8c99d1a54d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x55bc3e8c99d1a554 expref: -99 pid: 14209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186697.469957:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186698.069135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186698.069177:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186698.069216:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186698.069245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186698.069269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186698.069392:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915998080 00000100:00100000:0.0:1784186698.069403:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915998080 00000100:00100000:0.0:1784186698.069537:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:0.0:1784186698.069549:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a817dd11-5739-48aa-94ad-59c5eb22f761+13:2355:x1870854915998080:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186698.069631:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a817dd11-5739-48aa-94ad-59c5eb22f761+13:2355:x1870854915998080:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 83us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186698.069642:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 121 00000100:00100000:3.0:1784186698.070229:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915998208 00000100:00100000:3.0:1784186698.070235:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915998208 00000100:00100000:3.0:1784186698.070292:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915998592 00000100:00100000:3.0:1784186698.070295:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915998592 00000100:00100000:3.0:1784186698.070314:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:3.0:1784186698.070330:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:2354:x1870854915998208:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186698.070386:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:2354:x1870854915998208:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 65us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186698.070393:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:3.0:1784186698.070406:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:3.0:1784186698.070412:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:2355:x1870854915998592:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186698.070473:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:2355:x1870854915998592:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 60us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186698.070479:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00080000:2.0:1784186698.070695:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784186698.071967:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915998336 00000100:00100000:1.0:1784186698.071981:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915998336 00000100:00100000:1.0:1784186698.072043:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915998848 00000100:00100000:1.0:1784186698.072047:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915998848 00000100:00100000:1.0:1784186698.072069:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:1.0:1784186698.072078:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2355:x1870854915998336:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186698.072159:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2355:x1870854915998336:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 83us (2942us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186698.072167:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:1.0:1784186698.072200:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:1.0:1784186698.072206:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2355:x1870854915998848:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186698.072231:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2355:x1870854915998848:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 25us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186698.072237:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00080000:2.0:1784186698.072401:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784186698.072406:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784186698.076785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186698.076824:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186698.076965:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915998464 00000100:00100000:2.0:1784186698.076975:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915998464 00000100:00100000:2.0:1784186698.077043:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915998720 00000100:00100000:2.0:1784186698.077047:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915998720 00000100:00100000:2.0:1784186698.077083:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:2.0:1784186698.077092:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2354:x1870854915998464:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186698.077169:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2354:x1870854915998464:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 77us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186698.077177:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1784186698.077274:0:14848:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1784186698.077285:0:14848:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1784186698.077662:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784186698.077668:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784186698.078006:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:2.0:1784186698.078016:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2354:x1870854915998720:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186698.078106:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2354:x1870854915998720:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 91us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186698.078113:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00010000:00010000:0.0:1784186698.493667:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186699.276942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186699.277083:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915998976 00000100:00100000:3.0:1784186699.277093:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915998976 00000100:00100000:3.0:1784186699.277152:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:3.0:1784186699.277162:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:14376:x1870854915998976:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186699.277181:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186699.277201:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a55b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57695d expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.277277:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a562 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.277290:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a562 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.277301:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a562 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.277315:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a569 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.277323:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a569 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.277339:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a569 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.279882:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d1a570 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.279904:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d1a570 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.279917:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d1a570 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186699.280024:0:14214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784186699.280028:0:14214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784186699.280118:0:14214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d1a570 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280142:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a562 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280148:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a562 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280156:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a562 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280162:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16e00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186699.280166:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a562 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280173:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a562 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280186:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186699.280189:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186699.280193:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a562 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280199:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a562 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280213:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a569 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280220:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a569 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280226:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a569 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280237:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186699.280240:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a569 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280246:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a569 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280254:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9b9fc7718500) 00010000:00010000:3.0:1784186699.280256:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186699.280259:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a569 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280265:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a569 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280306:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a55b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57695d expref: 8 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280345:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16200/0x55bc3e8c99d1a570 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57695d expref: 7 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.280353:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b9fc7718800) 00010000:00010000:3.0:1784186699.280356:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784186699.280358:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf16200, rc 0) 00000100:00100000:3.0:1784186699.283930:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:14376:x1870854915998976:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 6756us (6984us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186699.283944:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:0.0:1784186699.292147:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186699.292232:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915999232 00000100:00100000:3.0:1784186699.292254:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915999232 00000100:00100000:3.0:1784186699.292315:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:3.0:1784186699.292341:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:14376:x1870854915999232:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186699.292373:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186699.292397:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1a577 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576964 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.292517:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d1a57e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.292532:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d1a57e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.292543:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d1a57e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.292710:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d1a585 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.292719:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d1a585 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.292726:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d1a585 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.295682:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a58c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.295707:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a58c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.295718:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a58c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186699.295735:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1784186699.296173:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d1a57e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296181:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d1a57e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296187:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d1a57e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296201:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186699.296205:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d1a57e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296211:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d1a57e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296224:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9b9fc7718800) 00010000:00010000:2.0:1784186699.296226:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186699.296230:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d1a57e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296235:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16000/0x55bc3e8c99d1a57e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296248:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d1a585 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296253:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d1a585 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296258:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d1a585 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296262:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17e00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186699.296265:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d1a585 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296270:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d1a585 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296285:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9b9fc7718d00) 00010000:00010000:2.0:1784186699.296287:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186699.296290:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d1a585 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.296295:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17e00/0x55bc3e8c99d1a585 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.300982:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17200/0x55bc3e8c99d1a577 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576964 expref: 10 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.301026:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766ce00/0x55bc3e8c99d1a58c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576964 expref: 9 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.301037:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:2.0:1784186699.301040:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186699.301044:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766ce00, rc 0) 00000100:00100000:2.0:1784186699.301210:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+9:14376:x1870854915999232:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 8870us (9070us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784186699.301219:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:0.0:1784186699.321757:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186699.321861:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915999360 00000100:00100000:3.0:1784186699.321871:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915999360 00000100:00100000:3.0:1784186699.321932:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:3.0:1784186699.321942:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+9:14376:x1870854915999360:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784186699.322064:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+9:14376:x1870854915999360:12345-192.168.201.31@tcp:59:lhsmtool_posix.0 Request processed in 123us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186699.322088:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:0.0:1784186699.382589:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186699.383126:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915999488 00000100:00100000:2.0:1784186699.383138:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915999488 00000100:00100000:2.0:1784186699.383199:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:2.0:1784186699.383210:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+9:14382:x1870854915999488:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186699.383232:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186699.383255:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a59a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57696b expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.383889:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.383902:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.383912:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.383927:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a5a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.383933:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.383939:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384168:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384174:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384178:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384182:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186699.384185:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384196:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384206:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:2.0:1784186699.384208:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186699.384211:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384215:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384224:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384228:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a5a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384232:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a5a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384234:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186699.384236:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a5a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384239:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a5a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384242:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b9fc5142e00) 00010000:00010000:2.0:1784186699.384244:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186699.384245:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a5a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384254:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a5a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384283:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a59a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57696b expref: 10 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384290:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:2.0:1784186699.384292:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186699.384294:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a59a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57696b expref: 10 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.384300:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d000, rc 0) 00000100:00100000:2.0:1784186699.385593:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+9:14382:x1870854915999488:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 2374us (3019us total) trans 0 rc 301/301 00000100:00100000:2.0:1784186699.385603:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 18 00000100:00100000:2.0:1784186699.397620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186699.397745:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915999616 00000100:00100000:0.0:1784186699.397756:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915999616 00000100:00100000:0.0:1784186699.397912:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:0.0:1784186699.397923:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5561563b-3fe0-476e-ab26-5c9f200a5d15+9:14382:x1870854915999616:12345-192.168.201.31@tcp:700:lfs.0 00000100:00100000:0.0:1784186699.398084:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5561563b-3fe0-476e-ab26-5c9f200a5d15+9:14382:x1870854915999616:12345-192.168.201.31@tcp:700:lfs.0 Request processed in 162us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186699.398109:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:0.0:1784186699.401693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186699.401845:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854915999872 00000100:00100000:3.0:1784186699.401856:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854915999872 00000100:00100000:3.0:1784186699.401972:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 19 00000100:00100000:3.0:1784186699.401983:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+9:14382:x1870854915999872:12345-192.168.201.31@tcp:36:lfs.0 00010000:00010000:3.0:1784186699.402042:0:14212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186699.402069:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a4dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5768e6 expref: 9 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.402089:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:3.0:1784186699.402094:0:14212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784186699.402411:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.402426:0:14212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576948 expref: 5 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.402435:0:14212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.402529:0:14212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576948 expref: 5 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.402544:0:14212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576948 expref: 5 pid: 14212 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186699.402559:0:14212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6313800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14212:1870854938009856:192.168.201.31@tcp:104: 00000100:00100000:3.0:1784186699.402662:0:14212:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65240 going to sleep for 11 seconds 00000100:00100000:0.0:1784186699.405623:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186699.405718:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916000000 00000100:00100000:2.0:1784186699.405727:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916000000 00010000:00010000:2.0:1784186699.405785:0:14199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576948 expref: 6 pid: 14212 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186699.405830:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:2.0:1784186699.405840:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:2356:x1870854916000000:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186699.405856:0:14199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186699.405862:0:14199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576948 expref: 6 pid: 14212 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.405892:0:14199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576948 expref: 6 pid: 14212 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.405915:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:2.0:1784186699.405920:0:14199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.405929:0:14199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.405937:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.405956:0:14199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186699.406009:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:2356:x1870854916000000:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 170us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186699.406017:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00010000:00010000:3.0:1784186699.406683:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a515 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576948 expref: 5 pid: 14212 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186699.406700:0:14212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6313800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14212:1870854938009856:192.168.201.31@tcp:104: 00010000:00010000:3.0:1784186699.406721:0:14212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.406730:0:14212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.406736:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.406843:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a5b6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.406854:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.406863:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186699.411237:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784186699.411257:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.411267:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.411274:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.411280:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186699.411285:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.411299:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.411334:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fc7718200) 00010000:00010000:2.0:1784186699.411337:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186699.411342:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.411697:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17600/0x55bc3e8c99d1a5af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784186699.411722:0:14212:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000033ffe85d reply state 000000000b4b9b1b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186699.411732:0:14212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186699.411955:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+10:14382:x1870854915999872:12345-192.168.201.31@tcp:36:lfs.0 Request processed in 9969us (10268us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1784186699.411963:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 19 00010000:00010000:1.0:1784186699.418612:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.418632:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a5b6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.418640:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a5b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.418647:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186699.418652:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a5b6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.418662:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a5b6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.418682:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b9fc7718500) 00010000:00010000:1.0:1784186699.418686:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186699.418691:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a5b6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.418716:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17000/0x55bc3e8c99d1a5b6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.518124:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186699.564729:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186699.564911:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916000128 00000100:00100000:0.0:1784186699.564922:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916000128 00000100:00100000:0.0:1784186699.564985:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:0.0:1784186699.565004:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+9:14390:x1870854916000128:12345-192.168.201.31@tcp:101:lctl.0 00010000:00010000:0.0:1784186699.565029:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186699.565055:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a5bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576972 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.565121:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d1a5c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.565135:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d1a5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.565147:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d1a5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186699.565205:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784186699.565210:0:14213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186699.565263:0:14213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d1a5c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.565288:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a5bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576972 expref: 11 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.565306:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb200/0x55bc3e8c99d1a5c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576972 expref: 10 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.565337:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011ad00) 00010000:00010000:0.0:1784186699.565340:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784186699.565343:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fb200, rc 0) 00000100:00100000:0.0:1784186699.565412:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+10:14390:x1870854916000128:12345-192.168.201.31@tcp:101:lctl.0 Request processed in 409us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186699.565419:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 20 00000100:00100000:0.0:1784186699.616836:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186699.617044:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916000256 00000100:00100000:2.0:1784186699.617054:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916000256 00000100:00100000:2.0:1784186699.617116:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:2.0:1784186699.617126:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:14391:x1870854916000256:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186699.617148:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186699.617169:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576979 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.617233:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a5d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.617260:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.617272:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186699.617373:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784186699.617378:0:14212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1784186699.617411:0:14212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.617488:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a5cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576979 expref: 7 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.617508:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766cc00/0x55bc3e8c99d1a5d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576979 expref: 6 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.617518:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011ad00) 00010000:00010000:2.0:1784186699.617521:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784186699.617524:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766cc00, rc 0) 00000100:00100000:2.0:1784186699.618059:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:14391:x1870854916000256:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 932us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186699.618067:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 21 00000100:00100000:2.0:1784186699.631787:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186699.631895:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916000384 00000100:00100000:1.0:1784186699.631905:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916000384 00000100:00100000:1.0:1784186699.631968:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:1.0:1784186699.631979:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:14391:x1870854916000384:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1784186699.632009:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186699.632030:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d200/0x55bc3e8c99d1a5d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576980 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632105:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a5e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632119:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632129:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632143:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a5e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632149:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632155:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632306:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c800/0x55bc3e8c99d1a5ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632315:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c800/0x55bc3e8c99d1a5ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632332:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c800/0x55bc3e8c99d1a5ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186699.632382:0:14214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1784186699.632386:0:14214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784186699.632418:0:14214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c800/0x55bc3e8c99d1a5ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632429:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a5e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632435:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a5e0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632482:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632488:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186699.632492:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a5e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632498:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a5e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632509:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011ad00) 00010000:00010000:1.0:1784186699.632518:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186699.632523:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a5e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632529:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a5e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632542:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632547:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a5e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632552:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632557:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186699.632560:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632565:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a5e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632572:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b9fd2ad4d00) 00010000:00010000:1.0:1784186699.632574:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186699.632576:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a5e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632580:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a5e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632607:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d200/0x55bc3e8c99d1a5d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576980 expref: 8 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632631:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c800/0x55bc3e8c99d1a5ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576980 expref: 7 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.632638:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b9fd2ad4700) 00010000:00010000:1.0:1784186699.632640:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784186699.632642:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffcc5c800, rc 0) 00000100:00100000:1.0:1784186699.632713:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+7:14391:x1870854916000384:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 736us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186699.632721:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 22 00000100:00100000:3.0:1784186699.652371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186699.652524:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916000640 00000100:00100000:2.0:1784186699.652536:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916000640 00000100:00100000:2.0:1784186699.652610:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:2.0:1784186699.652622:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+7:14391:x1870854916000640:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186699.652660:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186699.652684:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a5f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576987 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186699.652821:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784186699.652941:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a5f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576987 expref: 9 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.652957:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011ad00) 00010000:00010000:2.0:1784186699.652960:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784186699.652966:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a5f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576987 expref: 9 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.652982:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d400, rc 0) 00000100:00100000:2.0:1784186699.653058:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+8:14391:x1870854916000640:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 438us (698us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1784186699.653066:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 23 00000100:00100000:2.0:1784186699.678419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186699.679125:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916000896 00000100:00100000:0.0:1784186699.679137:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916000896 00000100:00100000:0.0:1784186699.679202:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 24 00000100:00100000:0.0:1784186699.679211:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+8:14391:x1870854916000896:12345-192.168.201.31@tcp:36:lfs.0 00010000:00010000:0.0:1784186699.679266:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784186699.679293:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c800/0x55bc3e8c99d1a5ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576980 expref: 8 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.679313:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b9fd2ad4700) 00010000:00010000:0.0:1784186699.679331:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784186699.679360:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a603 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.679373:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a603 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.679383:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a603 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784186699.679671:0:14213:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9d7a3c5 reply state 00000000e576e4f1 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a603 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186699.679696:0:14213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784186699.679711:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1784186699.679800:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+9:14391:x1870854916000896:12345-192.168.201.31@tcp:36:lfs.0 Request processed in 589us (1392us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784186699.679808:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 24 00010000:00010000:2.0:1784186699.682949:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a603 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.682969:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a603 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.682977:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a603 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.682984:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fae00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186699.683001:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a603 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.683030:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a603 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.683052:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b9fd011ab00) 00010000:00010000:2.0:1784186699.683056:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1784186699.683061:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a603 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186699.683067:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a603 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186699.684767:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186699.685123:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916001152 00000100:00100000:1.0:1784186699.685134:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916001152 00000100:00100000:1.0:1784186699.685186:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:1.0:1784186699.685195:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+8:14391:x1870854916001152:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1784186699.685899:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+9:14391:x1870854916001152:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 700us (1137us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1784186699.685910:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:0.0:1784186699.694067:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186699.694174:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916001408 00000100:00100000:1.0:1784186699.694186:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916001408 00000100:00100000:1.0:1784186699.694246:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:1.0:1784186699.694257:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+9:14391:x1870854916001408:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1784186699.694289:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186699.694315:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d200/0x55bc3e8c99d1a60a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57698e expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694413:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a611 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694478:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694491:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694506:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a618 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694513:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694518:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186699.694647:0:14214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784186699.694743:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a611 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694750:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a611 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694758:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a611 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694764:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186699.694768:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a611 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694775:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a611 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694797:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011ad00) 00010000:00010000:1.0:1784186699.694800:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186699.694805:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a611 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694812:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a611 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694825:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a618 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694831:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a618 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694836:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a618 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694841:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186699.694844:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a618 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694850:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a618 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694857:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b9fd2ad4d00) 00010000:00010000:1.0:1784186699.694860:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186699.694863:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a618 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694868:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a618 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694917:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d200/0x55bc3e8c99d1a60a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57698e expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694927:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011ad00) 00010000:00010000:1.0:1784186699.694930:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784186699.694933:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d200/0x55bc3e8c99d1a60a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57698e expref: 11 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.694942:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffcc5d200, rc 0) 00000100:00100000:1.0:1784186699.694999:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+10:14391:x1870854916001408:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 744us (949us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1784186699.695007:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 25 00000100:00100000:2.0:1784186699.699417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186699.699503:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916001536 00000100:00100000:0.0:1784186699.699514:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916001536 00000100:00100000:0.0:1784186699.699572:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:0.0:1784186699.699582:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+10:14391:x1870854916001536:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:0.0:1784186699.699606:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186699.699631:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a626 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576995 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.699717:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.699731:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.699742:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186699.699792:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1784186699.699796:0:14212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186699.699830:0:14212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.699857:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a626 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576995 expref: 12 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.699890:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576995 expref: 11 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.699898:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b9fd011a900) 00010000:00010000:0.0:1784186699.699901:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784186699.699905:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fb600, rc 0) 00000100:00100000:0.0:1784186699.699970:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+11:14391:x1870854916001536:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 389us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186699.699977:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 26 00000100:00100000:2.0:1784186699.705651:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186699.705725:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916001664 00000100:00100000:1.0:1784186699.705736:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916001664 00000100:00100000:1.0:1784186699.705795:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:1.0:1784186699.705805:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+11:14391:x1870854916001664:12345-192.168.201.31@tcp:37:lfs.0 00000100:00100000:1.0:1784186699.715198:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+11:14391:x1870854916001664:12345-192.168.201.31@tcp:37:lfs.0 Request processed in 9380us (9544us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186699.715213:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:2.0:1784186699.720144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186699.720238:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916001920 00000100:00100000:3.0:1784186699.720248:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916001920 00000100:00100000:3.0:1784186699.720541:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:3.0:1784186699.720553:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ff7001050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+11:14391:x1870854916001920:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:3.0:1784186699.720895:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ff7001050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+12:14391:x1870854916001920:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 343us (762us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1784186699.720917:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:2.0:1784186699.779233:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186699.779341:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916002048 00000100:00100000:0.0:1784186699.779360:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916002048 00000100:00100000:0.0:1784186699.779428:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:0.0:1784186699.779438:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+10:14397:x1870854916002048:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:0.0:1784186699.779503:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186699.779529:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff57699c expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779605:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a63b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779621:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a63b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779632:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a63b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779648:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a642 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779669:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779676:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779790:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a649 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779799:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a649 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779819:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a649 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186699.779848:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1784186699.779852:0:14213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186699.779890:0:14213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a649 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779909:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a63b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779916:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a63b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779923:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a63b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779928:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186699.779932:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a63b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779945:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a63b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779957:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011ad00) 00010000:00010000:0.0:1784186699.779960:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186699.779964:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a63b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779971:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a63b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779983:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779988:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a642 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779993:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.779998:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186699.780000:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.780005:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a642 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.780010:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9b9fd011ae00) 00010000:00010000:0.0:1784186699.780012:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784186699.780014:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a642 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.780030:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a642 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.780182:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57699c expref: 12 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.780196:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fae00/0x55bc3e8c99d1a649 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff57699c expref: 11 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186699.780203:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b9fd011a900) 00010000:00010000:0.0:1784186699.780205:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784186699.780207:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fae00, rc 0) 00000100:00100000:0.0:1784186699.780283:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+11:14397:x1870854916002048:12345-192.168.201.31@tcp:101:bash.0 Request processed in 844us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186699.780290:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:2.0:1784186699.787489:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186699.787630:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916002304 00000100:00100000:1.0:1784186699.787640:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916002304 00000100:00100000:1.0:1784186699.787710:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:1.0:1784186699.787720:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+11:14397:x1870854916002304:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1784186699.787745:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186699.787767:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d200/0x55bc3e8c99d1a650 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769a3 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.787937:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.787952:0:14214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576995 expref: 11 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.787961:0:14214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.788000:0:14214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576995 expref: 11 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.788013:0:14214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576995 expref: 11 pid: 14212 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186699.788028:0:14214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14214:1870854938009984:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186699.788132:0:14214:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58900 going to sleep for 11 seconds 00000100:00100000:1.0:1784186699.792102:0:14214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14214:1870854938009984:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186699.792135:0:14214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186699.793823:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186699.794240:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916002432 00000100:00100000:1.0:1784186699.794250:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916002432 00010000:00010000:1.0:1784186699.794291:0:14198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576995 expref: 12 pid: 14212 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186699.794340:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:1.0:1784186699.794372:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+12:2356:x1870854916002432:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186699.794387:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186699.794402:0:14198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576995 expref: 12 pid: 14212 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.794416:0:14198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576995 expref: 12 pid: 14212 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.794437:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a62d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576995 expref: 12 pid: 14212 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.794489:0:14198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b9fd011a900) 00010000:00010000:1.0:1784186699.794494:0:14198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.794504:0:14198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.794513:0:14198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.794817:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186699.794941:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+11:2356:x1870854916002432:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 569us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186699.794949:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00010000:00010000:3.0:1784186699.808617:0:14214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.808641:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.808729:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a65e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.808743:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a65e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.808763:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a65e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.809562:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a665 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.809574:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a665 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.809583:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a665 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784186699.809596:0:14214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784186699.809622:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.809629:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.809647:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.809653:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5de00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:3.0:1784186699.809657:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.809665:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.809678:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b9fd011a900) 00010000:00010000:3.0:1784186699.809682:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784186699.809687:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.809693:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5de00/0x55bc3e8c99d1a657 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784186699.809708:0:14214:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093b2f93c reply state 00000000a148e85a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a65e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186699.809718:0:14214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784186699.809753:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d200/0x55bc3e8c99d1a650 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769a3 expref: 14 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.809768:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a665 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769a3 expref: 13 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186699.809776:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:3.0:1784186699.809785:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1784186699.809787:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf16e00, rc 0) 00000100:00100000:3.0:1784186699.809857:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+14:14397:x1870854916002304:12345-192.168.201.31@tcp:101:bash.0 Request processed in 22137us (22422us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1784186699.809865:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00010000:00010000:1.0:1784186699.833059:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a65e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.833079:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a65e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.833107:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a65e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.833113:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17a00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186699.833118:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a65e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.833126:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a65e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.833146:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9b9fc7718b00) 00010000:00010000:1.0:1784186699.833149:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186699.833153:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a65e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.833160:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf17a00/0x55bc3e8c99d1a65e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186699.839401:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186699.839570:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916002560 00000100:00100000:1.0:1784186699.839580:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916002560 00000100:00100000:1.0:1784186699.839646:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:1.0:1784186699.839656:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+13:14397:x1870854916002560:12345-192.168.201.31@tcp:101:bash.0 00010000:00010000:1.0:1784186699.839687:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186699.839712:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a673 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769aa expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.839807:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.839847:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.839860:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186699.839913:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1784186699.839921:0:14212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784186699.839943:0:14212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.839955:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.839978:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a673 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769aa expref: 15 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.839996:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769aa expref: 14 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186699.840004:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:1.0:1784186699.840007:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784186699.840011:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffcc5ca00, rc 0) 00000100:00100000:1.0:1784186699.840085:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+14:14397:x1870854916002560:12345-192.168.201.31@tcp:101:bash.0 Request processed in 430us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186699.840092:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 29 00000100:00100000:2.0:1784186699.847203:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186699.847279:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916002816 00000100:00100000:1.0:1784186699.847288:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916002816 00000100:00100000:1.0:1784186699.847359:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:1.0:1784186699.847380:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+14:14397:x1870854916002816:12345-192.168.201.31@tcp:35:bash.0 00000001:00080000:1.0:1784186699.847711:0:14215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:1.0:1784186699.848643:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+16:14397:x1870854916002816:12345-192.168.201.31@tcp:35:bash.0 Request processed in 1258us (1444us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1784186699.848653:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000020:00080000:1.0:1784186699.848657:0:14215:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1784186699.902770:0:14246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784186700.004120:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.004265:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916003072 00000100:00100000:1.0:1784186700.004277:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916003072 00000100:00100000:1.0:1784186700.004374:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00100000:1.0:1784186700.004387:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+16:14407:x1870854916003072:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:1.0:1784186700.004427:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186700.004486:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769b1 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186700.004608:0:14214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784186700.004726:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a681 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769b1 expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.004741:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b9fd011ad00) 00010000:00010000:1.0:1784186700.004744:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784186700.004749:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769b1 expref: 18 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.004762:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffcc5c600, rc 0) 00000100:00100000:1.0:1784186700.004831:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+17:14407:x1870854916003072:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 447us (721us total) trans 8589934603 rc 301/301 00000100:00100000:1.0:1784186700.004838:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 30 00000100:00080000:3.0:1784186700.005076:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784186700.014700:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.014825:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916003328 00000100:00100000:1.0:1784186700.014835:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916003328 00000100:00100000:1.0:1784186700.014892:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:1.0:1784186700.014902:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+17:14407:x1870854916003328:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1784186700.015202:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+18:14407:x1870854916003328:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 301us (510us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1784186700.015210:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:0.0:1784186700.122734:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186700.123028:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916003584 00000100:00100000:2.0:1784186700.123049:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916003584 00000100:00100000:2.0:1784186700.123121:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:2.0:1784186700.123132:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+18:14410:x1870854916003584:12345-192.168.201.31@tcp:101:lfs.0 00010000:00010000:2.0:1784186700.123162:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186700.123187:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a68f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769b8 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.123282:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a696 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.123326:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a696 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.123339:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a696 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186700.123360:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784186700.123714:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a68f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769b8 expref: 21 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.123734:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a696 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769b8 expref: 20 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.123743:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:2.0:1784186700.123745:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186700.123817:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766d000, rc 0) 00000100:00100000:2.0:1784186700.123871:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+20:14410:x1870854916003584:12345-192.168.201.31@tcp:101:lfs.0 Request processed in 742us (1148us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1784186700.123878:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 31 00000100:00100000:0.0:1784186700.131085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186700.131136:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186700.131278:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916003712 00000100:00100000:2.0:1784186700.131289:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916003712 00000100:00100000:2.0:1784186700.131380:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:2.0:1784186700.131400:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+20:14410:x1870854916003712:12345-192.168.201.31@tcp:54:lfs.0 00010000:00010000:2.0:1784186700.131518:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6a4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.131538:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.131570:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.131603:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.131611:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6a4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.131618:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.131624:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186700.131630:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6a4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.131638:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6a4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.131652:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:2.0:1784186700.131654:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784186700.131661:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6a4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.131670:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6a4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186700.131927:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+20:14410:x1870854916003712:12345-192.168.201.31@tcp:54:lfs.0 Request processed in 535us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186700.131936:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 32 00000100:00100000:3.0:1784186700.132022:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916003840 00000100:00100000:3.0:1784186700.132028:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916003840 00000100:00100000:3.0:1784186700.132076:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:3.0:1784186700.132084:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+20:2354:x1870854916003840:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186700.132096:0:14199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186700.132115:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a696 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769b8 expref: 20 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186700.132127:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:3.0:1784186700.132131:0:14199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186700.132152:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+19:2354:x1870854916003840:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 70us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186700.132159:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:0.0:1784186700.142364:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.142503:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916004096 00000100:00100000:1.0:1784186700.142515:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916004096 00000100:00100000:1.0:1784186700.142576:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:1.0:1784186700.142585:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+19:14410:x1870854916004096:12345-192.168.201.31@tcp:35:lfs.0 00000100:00100000:1.0:1784186700.142853:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+20:14410:x1870854916004096:12345-192.168.201.31@tcp:35:lfs.0 Request processed in 267us (503us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1784186700.142860:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:3.0:1784186700.477728:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938010112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784186700.477804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186700.478090:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938010112 00000100:00100000:2.0:1784186700.478098:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938010112 00000100:00100000:2.0:1784186700.478165:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784186700.478175:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854938010112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784186700.478209:0:14850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186700.478268:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6312d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1870854938010112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186700.478276:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784186700.478426:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffd9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1870854938010112:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784186700.478646:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784186700.541904:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186700.555652:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186700.555760:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916004352 00000100:00100000:2.0:1784186700.555770:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916004352 00000100:00100000:2.0:1784186700.555839:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:2.0:1784186700.555850:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+20:14441:x1870854916004352:12345-192.168.201.31@tcp:101:cat.0 00010000:00010000:2.0:1784186700.555876:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186700.555898:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769bf expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.556010:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a6b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.556023:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.556035:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784186700.556046:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784186700.556242:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769bf expref: 23 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.556281:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769bf expref: 22 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.556290:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:2.0:1784186700.556293:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186700.556296:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c000, rc 0) 00000100:00100000:2.0:1784186700.556376:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+22:14441:x1870854916004352:12345-192.168.201.31@tcp:101:cat.0 Request processed in 527us (737us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1784186700.556383:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 33 00000100:00100000:0.0:1784186700.562260:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.562369:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916004608 00000100:00100000:1.0:1784186700.562379:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916004608 00000100:00100000:1.0:1784186700.562472:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:1.0:1784186700.562483:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+22:14441:x1870854916004608:12345-192.168.201.31@tcp:35:cat.0 00000100:00100000:1.0:1784186700.562869:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+23:14441:x1870854916004608:12345-192.168.201.31@tcp:35:cat.0 Request processed in 386us (618us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1784186700.562878:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 8 00000100:00100000:0.0:1784186700.569705:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.570077:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916004736 00000100:00100000:1.0:1784186700.570091:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916004736 00000100:00100000:1.0:1784186700.570171:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:1.0:1784186700.570182:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+23:2356:x1870854916004736:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784186700.570218:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186700.570248:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a6b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769bf expref: 23 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.570269:0:14198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:1.0:1784186700.570274:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186700.570364:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+22:2356:x1870854916004736:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 182us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186700.570372:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:0.0:1784186700.646728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.646839:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916004992 00000100:00100000:1.0:1784186700.646849:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916004992 00000100:00100000:1.0:1784186700.646914:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:1.0:1784186700.646924:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+22:14447:x1870854916004992:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:1.0:1784186700.646948:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186700.646967:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6c0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769c6 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.647296:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c400/0x55bc3e8c99d1a6c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.647321:0:14214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a665 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769a3 expref: 23 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.647328:0:14214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769aa expref: 23 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.647337:0:14214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c400/0x55bc3e8c99d1a6c7 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.647387:0:14214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769aa expref: 23 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.647401:0:14214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769aa expref: 23 pid: 14212 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186700.647416:0:14214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14214:1870854938010240:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186700.647561:0:14214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a665 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769a3 expref: 23 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.647570:0:14214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a665 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769a3 expref: 23 pid: 14214 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186700.647580:0:14214:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14214:1870854938010368:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186700.647605:0:14214:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec4a58e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784186700.652347:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186700.652587:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.652679:0:14214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14214:1870854938010240:192.168.201.31@tcp:104: 00000100:00100000:1.0:1784186700.652693:0:14214:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14214:1870854938010368:192.168.201.31@tcp:104: 00010000:00010000:1.0:1784186700.652722:0:14214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c400/0x55bc3e8c99d1a6c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186700.664880:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916005248 00000100:00100000:3.0:1784186700.664907:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916005248 00010000:00010000:3.0:1784186700.664968:0:14199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a665 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769a3 expref: 24 pid: 14214 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186700.665136:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916005120 00000100:00100000:3.0:1784186700.665140:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916005120 00010000:00010000:3.0:1784186700.665155:0:14199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769aa expref: 25 pid: 14212 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186700.665234:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:2.0:1784186700.665247:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe03a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+25:2356:x1870854916005248:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186700.665267:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186700.665276:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a665 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769a3 expref: 25 pid: 14214 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.665300:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a665 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769a3 expref: 25 pid: 14214 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.665342:0:14197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a665 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769a3 expref: 25 pid: 14214 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.665363:0:14197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:2.0:1784186700.665370:0:14197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c400/0x55bc3e8c99d1a6c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.665401:0:14197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c400/0x55bc3e8c99d1a6c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.665408:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186700.665501:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe03a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+24:2356:x1870854916005248:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 257us (13166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186700.665510:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:2.0:1784186700.665587:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:2.0:1784186700.665595:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+23:2356:x1870854916005120:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186700.665604:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186700.665609:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769aa expref: 23 pid: 14212 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.665619:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769aa expref: 23 pid: 14212 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.665632:0:14197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ca00/0x55bc3e8c99d1a67a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769aa expref: 23 pid: 14212 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.665643:0:14197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:2.0:1784186700.665647:0:14197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c400/0x55bc3e8c99d1a6c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.665655:0:14197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c400/0x55bc3e8c99d1a6c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.665663:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c400/0x55bc3e8c99d1a6c7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.665699:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186700.665719:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+22:2356:x1870854916005120:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 125us (13132us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186700.665727:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00010000:00010000:0.0:1784186700.666487:0:14214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c400/0x55bc3e8c99d1a6c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.666499:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c400/0x55bc3e8c99d1a6c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186700.666518:0:14214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784186700.666735:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6c0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769c6 expref: 23 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.666754:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c400/0x55bc3e8c99d1a6c7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769c6 expref: 22 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.666775:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:1.0:1784186700.666778:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784186700.666781:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffcc5c400, rc 0) 00000100:00100000:1.0:1784186700.666835:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+22:14447:x1870854916004992:12345-192.168.201.31@tcp:101:dd.0 Request processed in 19912us (20115us total) trans 8589934609 rc 0/0 00000100:00100000:1.0:1784186700.666842:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 34 00000100:00100000:0.0:1784186700.669661:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186700.669770:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916005504 00000100:00100000:2.0:1784186700.669779:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916005504 00000100:00100000:2.0:1784186700.669830:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 35 00000100:00100000:2.0:1784186700.669840:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+22:14447:x1870854916005504:12345-192.168.201.31@tcp:36:dd.0 00010000:00010000:2.0:1784186700.670252:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.670269:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.670280:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784186700.670361:0:14212:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:2.0:1784186700.670387:0:14212:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2bfcdc4 reply state 00000000e28c36ea transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186700.670396:0:14212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186700.670570:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+25:14447:x1870854916005504:12345-192.168.201.31@tcp:36:dd.0 Request processed in 730us (914us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1784186700.670578:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 35 00000020:00080000:2.0:1784186700.670584:0:14212:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784186700.672629:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.672666:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6d5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.672674:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.672680:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186700.672685:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.672692:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6d5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.672710:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:2.0:1784186700.672713:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186700.672718:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6d5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.672730:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a6d5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186700.673220:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.681395:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916005632 00000100:00100000:1.0:1784186700.681414:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916005632 00000100:00100000:1.0:1784186700.681539:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:1.0:1784186700.681549:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+24:14447:x1870854916005632:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:1.0:1784186700.681577:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186700.681600:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6dc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769cd expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.681664:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769cd expref: 25 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.681679:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6dc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769cd expref: 25 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.681699:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:1.0:1784186700.681702:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784186700.681707:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffcc5d400, rc 0) 00000100:00100000:1.0:1784186700.681778:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+25:14447:x1870854916005632:12345-192.168.201.31@tcp:101:dd.0 Request processed in 231us (8562us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186700.681800:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 36 00000100:00100000:0.0:1784186700.695662:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.695788:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916005888 00000100:00100000:1.0:1784186700.695799:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916005888 00000100:00100000:1.0:1784186700.695873:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:1.0:1784186700.695884:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+25:14447:x1870854916005888:12345-192.168.201.31@tcp:103:dd.0 00010000:00010000:1.0:1784186700.695902:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186700.695932:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6dc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769cd expref: 25 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.695952:0:14198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:1.0:1784186700.695957:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784186700.696019:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+24:14447:x1870854916005888:12345-192.168.201.31@tcp:103:dd.0 Request processed in 137us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186700.696028:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:3.0:1784186700.698165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186700.698234:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916006016 00000100:00100000:0.0:1784186700.698243:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916006016 00000100:00100000:0.0:1784186700.698299:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:0.0:1784186700.698317:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+24:14447:x1870854916006016:12345-192.168.201.31@tcp:58:dd.0 00010000:00010000:0.0:1784186700.698411:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.698429:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.698474:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784186700.699291:0:14213:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784186700.699498:0:14213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1784186700.699573:0:14213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1784186700.699683:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+24:14447:x1870854916006016:12345-192.168.201.31@tcp:58:dd.0 Request processed in 1363us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186700.699704:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 37 00000100:00100000:0.0:1784186700.706282:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186700.707769:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916006144 00000100:00100000:2.0:1784186700.707782:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916006144 00000100:00100000:2.0:1784186700.707983:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 38 00000100:00100000:2.0:1784186700.707995:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+24:14447:x1870854916006144:12345-192.168.201.31@tcp:101:dd.0 00010000:00010000:2.0:1784186700.708016:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186700.708048:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a6ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769d4 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.708106:0:14212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.708129:0:14212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a6ea lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769d4 expref: 25 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.708148:0:14212:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.708162:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a6ea lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769d4 expref: 25 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.708174:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:2.0:1784186700.708178:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784186700.708182:0:14212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a6ea lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769d4 expref: 25 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.708189:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766de00, rc 0) 00000100:00100000:2.0:1784186700.708315:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+25:14447:x1870854916006144:12345-192.168.201.31@tcp:101:dd.0 Request processed in 322us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186700.708324:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 38 00000040:00080000:3.0:1784186700.925705:0:14246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784186700.925714:0:14246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186700.925750:0:14246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784186700.925757:0:14246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1784186700.925883:0:14246:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6312a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14246:1870854938010496:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784186700.926023:0:14246:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ffec65240 going to sleep for 11 seconds 00000100:00100000:0.0:1784186700.935267:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.937535:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916006272 00000100:00100000:1.0:1784186700.937552:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916006272 00000100:00100000:1.0:1784186700.937630:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:1.0:1784186700.937642:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5561563b-3fe0-476e-ab26-5c9f200a5d15+26:14448:x1870854916006272:12345-192.168.201.31@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784186700.937747:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5561563b-3fe0-476e-ab26-5c9f200a5d15+26:14448:x1870854916006272:12345-192.168.201.31@tcp:900:lhsmtool_posix.0 Request processed in 108us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186700.937756:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:3.0:1784186700.944088:0:14246:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6312a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14246:1870854938010496:192.168.201.31@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784186700.952256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.952396:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916006400 00000100:00100000:1.0:1784186700.952405:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916006400 00000100:00100000:1.0:1784186700.952500:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:1.0:1784186700.952511:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+25:14448:x1870854916006400:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784186700.952584:0:14214:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784186700.952695:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+25:14448:x1870854916006400:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 186us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186700.952703:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 39 00000100:00100000:2.0:1784186700.958757:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.959343:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916006528 00000100:00100000:1.0:1784186700.959613:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916006528 00000100:00100000:1.0:1784186700.959679:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:1.0:1784186700.959690:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffd9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+25:14448:x1870854916006528:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784186700.959763:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.959781:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.959792:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.959858:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.959867:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.959876:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.959970:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d600/0x55bc3e8c99d1a6ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.959980:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d600/0x55bc3e8c99d1a6ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960004:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d600/0x55bc3e8c99d1a6ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784186700.960048:0:14212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1784186700.960053:0:14212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784186700.960080:0:14212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d600/0x55bc3e8c99d1a6ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960092:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960098:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960105:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960111:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5d400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186700.960121:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960129:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960140:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:1.0:1784186700.960144:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186700.960149:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960155:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d400/0x55bc3e8c99d1a6f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960180:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960186:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960193:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960198:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186700.960201:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960207:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960215:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9b9fd2ad4d00) 00010000:00010000:1.0:1784186700.960218:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186700.960221:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960226:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c600/0x55bc3e8c99d1a6f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960238:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d600/0x55bc3e8c99d1a6ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960243:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d600/0x55bc3e8c99d1a6ff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960248:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d600/0x55bc3e8c99d1a6ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960259:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5d600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186700.960263:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d600/0x55bc3e8c99d1a6ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960269:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d600/0x55bc3e8c99d1a6ff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960811:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:1.0:1784186700.960815:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186700.960819:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d600/0x55bc3e8c99d1a6ff lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186700.960825:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5d600/0x55bc3e8c99d1a6ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186700.960919:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffd9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+25:14448:x1870854916006528:12345-192.168.201.31@tcp:34:lhsmtool_posix.0 Request processed in 1228us (2169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186700.960929:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 40 00000100:00100000:3.0:1784186700.968742:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186700.968826:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916006784 00000100:00100000:0.0:1784186700.968837:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916006784 00000100:00100000:0.0:1784186700.968907:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:0.0:1784186700.968918:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+25:14448:x1870854916006784:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784186700.968941:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186700.968966:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a706 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769db expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969088:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a70d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969103:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a70d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969114:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a70d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186700.969126:0:14213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784186700.969234:0:14213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a70d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969243:0:14213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a70d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969250:0:14213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a70d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969274:0:14213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186700.969279:0:14213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a70d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969309:0:14213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a70d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969322:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:0.0:1784186700.969324:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784186700.969328:0:14213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a70d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969333:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a70d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969391:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a706 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769db expref: 27 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969401:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9b9fc5142d00) 00010000:00010000:0.0:1784186700.969404:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784186700.969408:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fbe00/0x55bc3e8c99d1a706 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769db expref: 27 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186700.969418:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fbe00, rc 0) 00000100:00100000:0.0:1784186700.969536:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+26:14448:x1870854916006784:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 620us (803us total) trans 8589934612 rc 301/301 00000100:00100000:0.0:1784186700.969545:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 41 00000100:00100000:2.0:1784186700.974663:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186700.974796:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916006912 00000100:00100000:1.0:1784186700.974810:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916006912 00000100:00100000:1.0:1784186700.974874:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:1.0:1784186700.974885:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+26:14448:x1870854916006912:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784186700.974929:0:14212:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784186700.975072:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+26:14448:x1870854916006912:12345-192.168.201.31@tcp:53:lhsmtool_posix.0 Request processed in 188us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186700.975080:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 42 00000100:00100000:3.0:1784186700.982829:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186700.983161:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916007168 00000100:00100000:2.0:1784186700.983173:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916007168 00000100:00100000:2.0:1784186700.983251:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:2.0:1784186700.983263:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+26:14448:x1870854916007168:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784186700.983293:0:14214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784186700.983339:0:14214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a71b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769e2 expref: -99 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784186700.984655:0:14214:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1784186700.984665:0:14214:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1784186700.984716:0:14214:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1784186700.985213:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a722 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.985233:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.985245:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a722 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.985625:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a71b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769e2 expref: 29 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.985647:0:14214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a722 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769e2 expref: 28 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186700.985657:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:2.0:1784186700.985660:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784186700.985664:0:14214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9fc766c600, rc 0) 00000100:00100000:2.0:1784186700.985787:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+28:14448:x1870854916007168:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 2525us (2967us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1784186700.985795:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 43 00000100:00100000:0.0:1784186700.989797:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784186700.989839:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854938010624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784186700.989918:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186700.990033:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938010624 00000100:00100000:2.0:1784186700.990041:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938010624 00000100:00100000:2.0:1784186700.990123:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784186700.990141:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854938010624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784186700.990179:0:14850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784186700.990223:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854938010624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186700.990231:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784186700.995348:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854938011008:0@lo:400:kworker.0 00000100:00100000:1.0:1784186700.995782:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854938010880:0@lo:400:kworker.0 00000100:00100000:3.0:1784186700.996336:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854938011136:0@lo:400:kworker.0 00000100:00100000:1.0:1784186700.996438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186700.997586:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938010880 00000100:00100000:2.0:1784186700.997596:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938010880 00000100:00100000:2.0:1784186700.997648:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784186700.997690:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854938010880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784186700.997762:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1870854938010880:12345-0@lo:400:kworker.0 Request processed in 106us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186700.997769:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784186700.999133:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1870854938010880:0@lo:400:kworker.0 00000100:00080000:1.0:1784186701.017151:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784186701.017182:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3309:1870854938010752:0@lo:400:kworker.0 00000100:00100000:1.0:1784186701.019650:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186701.027004:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784186701.027288:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938010752 00000100:00100000:3.0:1784186701.027308:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938010752 00000100:00100000:3.0:1784186701.027356:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784186701.027366:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:3309:x1870854938010752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186701.027767:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fb25396a-5e10-4f60-be9a-8f767a2ae4fa+19:3309:x1870854938010752:12345-0@lo:400:kworker.0 Request processed in 402us (8122us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186701.027775:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1784186701.027826:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938011136 00000100:00100000:3.0:1784186701.027837:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938011136 00000100:00100000:3.0:1784186701.027889:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784186701.027895:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854938011136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784186701.027933:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1870854938011136:12345-0@lo:400:kworker.0 Request processed in 38us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186701.027940:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784186701.027982:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1870854938011136:0@lo:400:kworker.0 00000100:00100000:0.0:1784186701.028652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784186701.028699:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784186701.030739:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938011008 00000100:00100000:3.0:1784186701.030753:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938011008 00000100:00100000:3.0:1784186701.030810:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784186701.030820:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854938011008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784186701.032043:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3309:1870854938010752:0@lo:400:kworker.0 00000100:00100000:0.0:1784186701.032077:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffeeb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854938010624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784186701.032102:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1870854938011008:12345-0@lo:400:kworker.0 Request processed in 1280us (3450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186701.032115:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784186701.032135:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1870854938011008:0@lo:400:kworker.0 00000100:00080000:3.0:1784186701.032226:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784186701.033270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.033728:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916007424 00000100:00100000:3.0:1784186701.033737:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916007424 00000100:00100000:2.0:1784186701.033893:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:2.0:1784186701.033903:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+28:14448:x1870854916007424:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784186701.033965:0:14214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186701.033993:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a722 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769e2 expref: 28 pid: 14214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034012:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b9fc5142e00) 00010000:00010000:2.0:1784186701.034023:0:14214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784186701.034067:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a730 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034082:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a730 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034091:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a730 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034160:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a737 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92bc83fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034169:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a737 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92bc83fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034176:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a737 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92bc83fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034487:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a730 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034495:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a730 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034501:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a730 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034506:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c400 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186701.034510:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a730 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034516:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a730 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034525:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9b9fd011a900) 00010000:00010000:2.0:1784186701.034527:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186701.034530:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a730 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034536:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c400/0x55bc3e8c99d1a730 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034551:0:14214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a737 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92bc83fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034557:0:14214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a737 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92bc83fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034562:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a737 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92bc83fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034566:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186701.034568:0:14214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a737 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92bc83fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034574:0:14214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a737 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92bc83fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034580:0:14214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x92bc83fd (ffff9b9fc5142100) 00010000:00010000:2.0:1784186701.034583:0:14214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186701.034585:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a737 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92bc83fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.034590:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c000/0x55bc3e8c99d1a737 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92bc83fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186701.034677:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+27:14448:x1870854916007424:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 774us (1411us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784186701.034685:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 44 00000100:00100000:0.0:1784186701.039625:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.039781:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916007552 00000100:00100000:3.0:1784186701.039791:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916007552 00000100:00100000:3.0:1784186701.039847:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:3.0:1784186701.039857:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+27:14448:x1870854916007552:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186701.039892:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186701.039915:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a73e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769e9 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.039950:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16a00/0x55bc3e8c99d1a745 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.039981:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16a00/0x55bc3e8c99d1a745 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.039992:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16a00/0x55bc3e8c99d1a745 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.040099:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a73e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769e9 expref: 29 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.040116:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16a00/0x55bc3e8c99d1a745 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769e9 expref: 28 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.040124:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:3.0:1784186701.040127:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784186701.040130:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf16a00, rc 0) 00000100:00100000:3.0:1784186701.040192:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+28:14448:x1870854916007552:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 336us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186701.040200:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 45 00000100:00100000:0.0:1784186701.045882:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.045991:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916007808 00000100:00100000:3.0:1784186701.046002:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916007808 00000100:00100000:3.0:1784186701.046061:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 46 00000100:00100000:3.0:1784186701.046073:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+28:14448:x1870854916007808:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784186701.046169:0:14214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a74c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.046186:0:14214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a74c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.046227:0:14214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a74c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784186701.046830:0:14214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1784186701.046844:0:14214:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 479768401976ns, next at 480768398718ns, rc = 0 00000004:00010000:3.0:1784186701.046989:0:14214:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c05dcc8 reply state 000000007f1b1072 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a74c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186701.047517:0:14214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784186701.047663:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+30:14448:x1870854916007808:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 1589us (1787us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1784186701.047686:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 46 00010000:00010000:1.0:1784186701.056845:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a74c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.056868:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a74c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.056877:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a74c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.056884:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf16e00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186701.056888:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a74c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.056896:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a74c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.056914:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:1.0:1784186701.056917:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784186701.056921:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a74c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.056928:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16e00/0x55bc3e8c99d1a74c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186701.057081:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.057623:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916007936 00000100:00100000:3.0:1784186701.057632:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916007936 00000100:00100000:3.0:1784186701.057691:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:3.0:1784186701.057701:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+29:14448:x1870854916007936:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784186701.057726:0:14213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784186701.057742:0:14213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a753 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769f0 expref: -99 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.057803:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f0 expref: 30 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.057817:0:14213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f0 expref: 30 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.057834:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:3.0:1784186701.057837:0:14213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784186701.057840:0:14213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffdf16400, rc 0) 00000100:00100000:3.0:1784186701.057898:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+30:14448:x1870854916007936:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 198us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186701.057913:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 47 00000100:00100000:2.0:1784186701.061642:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.061716:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916008064 00000100:00100000:3.0:1784186701.061727:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916008064 00000100:00100000:3.0:1784186701.061791:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:3.0:1784186701.061801:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2356:x1870854916008064:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1784186701.061962:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784186701.062677:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:2356:x1870854916008064:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 874us (1042us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784186701.062686:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:1.0:1784186701.081664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.081900:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916008320 00000100:00100000:3.0:1784186701.081912:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916008320 00000100:00100000:3.0:1784186701.081968:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:3.0:1784186701.081981:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+30:14448:x1870854916008320:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784186701.083381:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+31:14448:x1870854916008320:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 1397us (1719us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1784186701.083394:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 9 00000100:00100000:3.0:1784186701.086170:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186701.086396:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916008576 00000100:00100000:0.0:1784186701.086407:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916008576 00000100:00100000:0.0:1784186701.086487:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:0.0:1784186701.086499:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+31:14448:x1870854916008576:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784186701.087358:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+31:14448:x1870854916008576:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 858us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186701.087368:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 48 00000100:00100000:1.0:1784186701.101708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186701.102374:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916008704 00000100:00100000:0.0:1784186701.102386:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916008704 00000100:00100000:0.0:1784186701.102476:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:0.0:1784186701.102489:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+31:14448:x1870854916008704:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784186701.102511:0:14212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186701.102535:0:14212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a75a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769f7 expref: -99 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.102605:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a761 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.102628:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a761 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.102640:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a761 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784186701.102688:0:14212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784186701.102710:0:14212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a761 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.102742:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fa200/0x55bc3e8c99d1a75a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f7 expref: 33 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.102763:0:14212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a761 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f7 expref: 32 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.102784:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:0.0:1784186701.102788:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784186701.102792:0:14212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fb000, rc 0) 00000100:00100000:0.0:1784186701.102856:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+32:14448:x1870854916008704:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 369us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186701.102863:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 49 00000100:00100000:2.0:1784186701.109286:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186701.109399:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916008832 00000100:00100000:1.0:1784186701.109410:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916008832 00000100:00100000:1.0:1784186701.109503:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:1.0:1784186701.109515:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+6:2355:x1870854916008832:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784186701.109535:0:14845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784186701.109559:0:14845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009213ab20/0x55bc3e8c99d1a768 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff5769fe expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784186701.109588:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a58874d, blocks: 0x1 00010000:00010000:1.0:1784186701.109609:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=479s v=(0 0) 00010000:00010000:1.0:1784186701.109614:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186701.109624:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009213ab20/0x55bc3e8c99d1a768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769fe expref: 7 pid: 14845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.109644:0:14845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009213ab20/0x55bc3e8c99d1a768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769fe expref: 7 pid: 14845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.109658:0:14845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ffcc5cc00, rc 0) 00000100:00100000:1.0:1784186701.109724:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:2355:x1870854916008832:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 211us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186701.109732:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000001:00080000:2.0:1784186701.112036:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:2.0:1784186701.112067:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:2.0:1784186701.112086:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1784186701.112094:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000001:00080000:2.0:1784186701.112121:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1784186701.122995:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186701.123582:0:14214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916009088 00000100:00100000:2.0:1784186701.123593:0:14214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916009088 00000100:00100000:2.0:1784186701.123655:0:14214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:2.0:1784186701.123666:0:14214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+16:14448:x1870854916009088:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784186701.123786:0:14214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+16:14448:x1870854916009088:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 121us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186701.123793:0:14214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 50 00000100:00100000:3.0:1784186701.146712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186701.146862:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916009216 00000100:00100000:0.0:1784186701.146873:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916009216 00000100:00100000:0.0:1784186701.146939:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 51 00000100:00100000:0.0:1784186701.146949:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+16:14448:x1870854916009216:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1784186701.195861:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+16:14448:x1870854916009216:12345-192.168.201.31@tcp:44:lhsmtool_posix.0 Request processed in 48901us (49149us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186701.195876:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 51 00000001:00080000:2.0:1784186701.195916:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000004:00080000:2.0:1784186701.195927:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1784186701.196417:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854938011264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784186701.196496:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186701.196571:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938011264 00000100:00100000:2.0:1784186701.196579:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938011264 00000100:00100000:2.0:1784186701.196617:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784186701.196642:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1870854938011264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1784186701.196797:0:14848:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784186701.196802:0:14848:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1784186701.196804:0:14848:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784186701.196806:0:14848:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784186701 -> 1784186701 00002000:00010000:2.0:1784186701.196808:0:14848:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1784186701.196843:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1870854938011264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (347us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1784186701.196850:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:2.0:1784186701.196892:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b9fd11b5c00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1784186701.196898:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1870854938011264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784186701.197898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186701.197978:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916009344 00000100:00100000:1.0:1784186701.197984:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916009344 00000100:00100000:1.0:1784186701.198027:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:1.0:1784186701.198036:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:2356:x1870854916009344:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1784186701.198158:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:2356:x1870854916009344:12345-192.168.201.31@tcp:16:lhsmtool_posix.0 Request processed in 123us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186701.198165:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1784186701.203094:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186701.203486:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916009600 00000100:00100000:1.0:1784186701.203498:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916009600 00000100:00100000:1.0:1784186701.203563:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 52 00000100:00100000:1.0:1784186701.203573:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+14:14448:x1870854916009600:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784186701.203629:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784186701.203657:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb000/0x55bc3e8c99d1a761 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f7 expref: 14 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.203676:0:14213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:1.0:1784186701.203681:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784186701.203714:0:14213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c200/0x55bc3e8c99d1a76f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.203728:0:14213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c200/0x55bc3e8c99d1a76f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.203737:0:14213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c200/0x55bc3e8c99d1a76f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784186701.203959:0:14213:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002aa13bf4 reply state 0000000077ff1b74 transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c200/0x55bc3e8c99d1a76f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186701.203969:0:14213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784186701.204728:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+15:14448:x1870854916009600:12345-192.168.201.31@tcp:36:lhsmtool_posix.0 Request processed in 1150us (1639us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1784186701.204759:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 52 00010000:00010000:2.0:1784186701.209086:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c200/0x55bc3e8c99d1a76f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.209104:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c200/0x55bc3e8c99d1a76f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.209112:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c200/0x55bc3e8c99d1a76f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.209118:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5c200 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:2.0:1784186701.209123:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c200/0x55bc3e8c99d1a76f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.209131:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c200/0x55bc3e8c99d1a76f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.209150:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:2.0:1784186701.209167:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784186701.209172:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c200/0x55bc3e8c99d1a76f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.209178:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5c200/0x55bc3e8c99d1a76f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186701.210850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186701.211621:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916009728 00000100:00100000:0.0:1784186701.211647:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916009728 00000100:00100000:0.0:1784186701.211709:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:0.0:1784186701.211719:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:14448:x1870854916009728:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784186701.211738:0:14848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784186701.211758:0:14848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5872eb7ff576a05 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.211790:0:14848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009213ab20/0x55bc3e8c99d1a768 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769fe expref: 8 pid: 14845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.211799:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186701.211803:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186701.211809:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 8 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.211845:0:14848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009213ab20/0x55bc3e8c99d1a768 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769fe expref: 8 pid: 14845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.211860:0:14848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009213ab20/0x55bc3e8c99d1a768 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769fe expref: 8 pid: 14845 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186701.211876:0:14848:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe311f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14848:1870854938011392:192.168.201.31@tcp:104: 00000100:00100000:0.0:1784186701.211982:0:14848:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1dbea80 going to sleep for 11 seconds 00000100:00100000:1.0:1784186701.221417:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.221535:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916009856 00000100:00100000:3.0:1784186701.221544:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916009856 00010000:00010000:3.0:1784186701.221585:0:14199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009213ab20/0x55bc3e8c99d1a768 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769fe expref: 9 pid: 14845 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186701.221631:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:3.0:1784186701.221642:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+9:2357:x1870854916009856:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784186701.221675:0:14199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784186701.221702:0:14199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009213ab20/0x55bc3e8c99d1a768 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769fe expref: 9 pid: 14845 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.221718:0:14199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009213ab20/0x55bc3e8c99d1a768 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769fe expref: 9 pid: 14845 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.221745:0:14199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186701.221750:0:14199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186701.221758:0:14199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 9 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.221768:0:14199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 9 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.221807:0:14199:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 9 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186701.221821:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec6311500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14199:1870854938011520:192.168.201.31@tcp:105: 00000100:00100000:3.0:1784186701.221919:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fe547c540 going to sleep for 11 seconds 00010000:00010000:0.0:1784186701.223192:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009213ab20/0x55bc3e8c99d1a768 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769fe expref: 9 pid: 14845 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186701.223237:0:14848:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe311f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14848:1870854938011392:192.168.201.31@tcp:104: 00010000:00010000:0.0:1784186701.223267:0:14848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 8 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.223301:0:14848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b9ec58fa200, rc 0) 00000100:00100000:0.0:1784186701.224133:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+8:14448:x1870854916009728:12345-192.168.201.31@tcp:101:lhsmtool_posix.0 Request processed in 12410us (13286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186701.224143:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:3.0:1784186701.226663:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec6311500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14199:1870854938011520:192.168.201.31@tcp:105: 00010000:00010000:3.0:1784186701.226689:0:14199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784186701.226756:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:2357:x1870854916009856:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 5115us (5350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186701.226767:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:3.0:1784186701.229518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186701.230189:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916009984 00000100:00100000:1.0:1784186701.230199:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916009984 00000100:00100000:1.0:1784186701.230262:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1784186701.230272:0:14845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:2357:x1870854916009984:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784186701.230545:0:14845:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784186701.230548:0:14845:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1784186700 00002000:00010000:1.0:1784186701.230551:0:14845:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1784186699 00002000:00010000:1.0:1784186701.230553:0:14845:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784186701 -> 1784186700 00002000:00010000:1.0:1784186701.230555:0:14845:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1784186701.230623:0:14845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+8:2357:x1870854916009984:12345-192.168.201.31@tcp:2:lhsmtool_posix.0 Request processed in 351us (1113us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1784186701.230631:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 16 00000100:00100000:1.0:1784186701.235807:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186701.236917:0:14847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916010112 00000100:00100000:2.0:1784186701.236931:0:14847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916010112 00000100:00100000:2.0:1784186701.236993:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:2.0:1784186701.237004:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+8:2355:x1870854916010112:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784186701.237066:0:14847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.237089:0:14847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 8 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.237098:0:14847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186701.237103:0:14847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186701.237107:0:14847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.237147:0:14847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 8 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.237164:0:14847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 8 pid: 14848 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186701.237201:0:14847:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14847:1870854938011648:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186701.237304:0:14847:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0861300 going to sleep for 11 seconds 00000100:00100000:2.0:1784186701.242115:0:14847:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14847:1870854938011648:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186701.242149:0:14847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186701.244289:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186701.245347:0:14198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916010240 00000100:00100000:2.0:1784186701.245362:0:14198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916010240 00010000:00010000:2.0:1784186701.245412:0:14198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 9 pid: 14848 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186701.245500:0:14198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1784186701.245511:0:14198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+9:2356:x1870854916010240:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186701.245529:0:14198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186701.245553:0:14198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 9 pid: 14848 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.245568:0:14198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 9 pid: 14848 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.245593:0:14198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a776 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff576a05 expref: 9 pid: 14848 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.245630:0:14198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186701.245635:0:14198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784186701.245641:0:14198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.245651:0:14198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.245689:0:14198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186701.245753:0:14198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+8:2356:x1870854916010240:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 244us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186701.245762:0:14198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00010000:00010000:3.0:1784186701.247014:0:14847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.247045:0:14847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.247090:0:14847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.247099:0:14847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.247107:0:14847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.247114:0:14847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186701.247118:0:14847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.247126:0:14847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.247141:0:14847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.247149:0:14847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6edb0b8/0x55bc3e8c99d1a77d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186701.247268:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffeeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+7:2355:x1870854916010112:12345-192.168.201.31@tcp:1:lhsmtool_posix.0 Request processed in 10263us (11467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186701.247279:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 17 00000100:00100000:1.0:1784186701.253235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186701.253329:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916010496 00000100:00100000:2.0:1784186701.253339:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916010496 00000100:00100000:2.0:1784186701.253414:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 53 00000100:00100000:2.0:1784186701.253425:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+14:14448:x1870854916010496:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784186701.253544:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a784 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.253564:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a784 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.253576:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a784 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.253827:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.253846:0:14212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a753 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f0 expref: 15 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.253855:0:14212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.253894:0:14212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f0 expref: 15 pid: 14213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.253908:0:14212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a753 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f0 expref: 15 pid: 14213 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186701.253924:0:14212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14212:1870854938011776:192.168.201.31@tcp:104: 00000100:00100000:2.0:1784186701.254005:0:14212:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd0861300 going to sleep for 11 seconds 00000100:00100000:2.0:1784186701.272913:0:14212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14212:1870854938011776:192.168.201.31@tcp:104: 00010000:00010000:2.0:1784186701.272955:0:14212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186701.275704:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186701.275806:0:14197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916010624 00000100:00100000:2.0:1784186701.275816:0:14197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916010624 00010000:00010000:2.0:1784186701.275859:0:14197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a753 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f0 expref: 16 pid: 14213 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186701.275903:0:14197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:2.0:1784186701.275912:0:14197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe36df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+16:2357:x1870854916010624:12345-192.168.201.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784186701.275932:0:14197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784186701.275955:0:14197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a753 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f0 expref: 16 pid: 14213 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.275967:0:14197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a753 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f0 expref: 16 pid: 14213 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.275991:0:14197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffdf16400/0x55bc3e8c99d1a753 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769f0 expref: 16 pid: 14213 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.276008:0:14197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:2.0:1784186701.276013:0:14197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.276034:0:14197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.276043:0:14197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.276175:0:14197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784186701.276233:0:14197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+15:2357:x1870854916010624:12345-192.168.201.31@tcp:103:ldlm_bl.0 Request processed in 321us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186701.276241:0:14197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00010000:00010000:0.0:1784186701.276682:0:14212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.276691:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784186701.276902:0:14212:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1784186701.277351:0:14212:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:0.0:1784186701.277419:0:14212:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1784186701.277551:0:14212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe311f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14212:1870854938011904:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784186701.277677:0:14212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784186701.277722:0:14212:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186701.278074:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938011904 00000100:00100000:3.0:1784186701.278082:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938011904 00000100:00100000:3.0:1784186701.278126:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784186701.278136:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14212:x1870854938011904:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784186701.278223:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14212:x1870854938011904:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186701.278231:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784186701.279983:0:14212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe311f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14212:1870854938011904:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1784186701.286007:0:14212:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:1.0:1784186701.286134:0:14212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ec71a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14212:1870854938012032:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784186701.286201:0:14212:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784186701.286248:0:14212:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9fd1dbea80 going to sleep for 11 seconds 00000100:00100000:3.0:1784186701.286376:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938012032 00000100:00100000:3.0:1784186701.286386:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938012032 00000100:00100000:3.0:1784186701.286458:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784186701.286467:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14212:x1870854938012032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1784186701.286649:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14212:x1870854938012032:12345-0@lo:1000:mdt00_000.0 Request processed in 183us (447us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1784186701.286659:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784186701.286853:0:14212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ec71a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14212:1870854938012032:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1784186701.286893:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.286919:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.286926:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.286932:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186701.286936:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.286945:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.286964:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:0.0:1784186701.286967:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784186701.286972:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.286977:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766c600/0x55bc3e8c99d1a78b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.287010:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.287016:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.287021:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.287026:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb600 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:0.0:1784186701.287035:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.287041:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.287051:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:0.0:1784186701.287054:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784186701.287061:0:14212:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a6ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769d4 expref: 18 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.287071:0:14212:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a6ea lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769d4 expref: 18 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.287080:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a6ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769d4 expref: 18 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.287108:0:14212:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766de00/0x55bc3e8c99d1a6ea lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.31@tcp remote: 0xd5872eb7ff5769d4 expref: 18 pid: 14212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186701.287121:0:14212:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9ffe311f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14212:1870854938012160:192.168.201.31@tcp:105: 00000100:00100000:0.0:1784186701.287196:0:14212:0:(client.c:2702:ptlrpc_set_wait()) set ffff9b9ec503f480 going to sleep for 11 seconds 00000100:00100000:1.0:1784186701.298290:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.301263:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916010752 00000100:00100000:3.0:1784186701.301282:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916010752 00000100:00100000:3.0:1784186701.301383:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:3.0:1784186701.301395:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ff7003450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+19:14447:x1870854916010752:12345-192.168.201.31@tcp:49:dd.0 00000100:00100000:3.0:1784186701.301608:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ff7003450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+19:14447:x1870854916010752:12345-192.168.201.31@tcp:49:dd.0 Request processed in 214us (3327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186701.301617:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 10 00000100:00100000:0.0:1784186701.302781:0:14212:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9ffe311f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14212:1870854938012160:192.168.201.31@tcp:105: 00010000:00010000:0.0:1784186701.302812:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.302823:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ec58fb600/0x55bc3e8c99d1a6e3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304781:0:14212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ce00/0x55bc3e8c99d1a792 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304833:0:14212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ce00/0x55bc3e8c99d1a792 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304851:0:14212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ce00/0x55bc3e8c99d1a792 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304866:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ce00/0x55bc3e8c99d1a792 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304872:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ce00/0x55bc3e8c99d1a792 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304890:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ce00/0x55bc3e8c99d1a792 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304898:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5ce00 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186701.304902:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ce00/0x55bc3e8c99d1a792 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304910:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ce00/0x55bc3e8c99d1a792 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304922:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:1.0:1784186701.304925:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784186701.304930:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ce00/0x55bc3e8c99d1a792 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304935:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9ffcc5ce00/0x55bc3e8c99d1a792 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304950:0:14212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a784 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304962:0:14212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a784 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304968:0:14212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a784 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304974:0:14212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d000 already unused, calling callback (ffffffffc21a74f0) 00010000:00010000:1.0:1784186701.304977:0:14212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a784 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304982:0:14212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a784 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.304991:0:14212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9b9fc7718c00) 00010000:00010000:1.0:1784186701.304993:0:14212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784186701.304996:0:14212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a784 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.305001:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d000/0x55bc3e8c99d1a784 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186701.305350:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+18:14448:x1870854916010496:12345-192.168.201.31@tcp:57:lhsmtool_posix.0 Request processed in 51920us (52119us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1784186701.305362:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 53 00000020:00080000:1.0:1784186701.305369:0:14212:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784186701.306241:0:14246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784186701.306247:0:14246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186701.306279:0:14246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784186701.306285:0:14246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1784186701.314578:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.314710:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916011008 00000100:00100000:3.0:1784186701.314724:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916011008 00000100:00100000:3.0:1784186701.314785:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 11 00000100:00100000:3.0:1784186701.314796:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+18:14448:x1870854916011008:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1784186701.316548:0:14216:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1784186701.316674:0:14216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:2.0:1784186701.316736:0:14216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a799 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.316753:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a799 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.316777:0:14216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a799 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.316787:0:14216:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a799 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.316793:0:14216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a799 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.316799:0:14216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a799 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186701.316827:0:14216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784186701.319213:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+20:14448:x1870854916011008:12345-192.168.201.31@tcp:35:lhsmtool_posix.0 Request processed in 4402us (4629us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1784186701.319230:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 11 00000020:00080000:2.0:1784186701.319237:0:14216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784186701.319378:0:14200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784186701.319388:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a799 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.319419:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766d400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186701.319425:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a799 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.319433:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a799 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.319474:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9b9fc7718400) 00010000:00010000:1.0:1784186701.319477:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784186701.319482:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a799 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.319487:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b9fc766d400/0x55bc3e8c99d1a799 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.319502:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186701.319504:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784186701.319505:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784186701.566572:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186701.741133:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:2.0:1784186701.741182:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.741392:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916011264 00000100:00100000:3.0:1784186701.741402:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916011264 00000100:00100000:3.0:1784186701.741499:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916011136 00000100:00100000:3.0:1784186701.741502:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916011136 00000100:00100000:3.0:1784186701.741524:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:3.0:1784186701.741534:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+8:2354:x1870854916011264:12345-192.168.201.31@tcp:4:dd.0 00002000:00010000:3.0:1784186701.741589:0:14851:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a58874c, atime: 0x6a58874b, ctime: 0x6a58874c, blocks: 0x1 00010000:00010000:3.0:1784186701.741599:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a7a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.741616:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1784186701.741621:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186701.741628:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a7a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186701.741644:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a7a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186701.754419:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.754494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186701.754542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186701.754672:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1784186701.754681:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1784186701.755151:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784186701.755170:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916011392 00000100:00100000:2.0:1784186701.755179:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916011392 00000100:00100000:2.0:1784186701.755228:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784186701.755236:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916011520 00000100:00100000:2.0:1784186701.755239:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916011520 00000100:00100000:2.0:1784186701.755253:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784186701.755259:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916011648 00000100:00100000:2.0:1784186701.755273:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916011648 00000100:00100000:0.0:1784186701.756988:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:0.0:1784186701.757007:0:16341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5561563b-3fe0-476e-ab26-5c9f200a5d15+12:2354:x1870854916011136:12345-192.168.201.31@tcp:4:dd.0 00010000:00010000:0.0:1784186701.757403:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da1b7e0/0x55bc3e8c99d1a7a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.757422:0:16341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186701.757426:0:16341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186701.757432:0:16341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da1b7e0/0x55bc3e8c99d1a7a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.757522:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da1b7e0/0x55bc3e8c99d1a7a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186701.804554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186701.804678:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1784186701.804689:0:14853:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1784186701.808562:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916011776 00000100:00100000:1.0:1784186701.808582:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916011776 00000100:00100000:0.0:1784186701.809162:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:0.0:1784186701.809174:0:16342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5561563b-3fe0-476e-ab26-5c9f200a5d15+14:2355:x1870854916011392:12345-192.168.201.31@tcp:4:dd.0 00010000:00010000:0.0:1784186701.809217:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a7ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.809236:0:16342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186701.809241:0:16342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186701.809249:0:16342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a7ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186701.809271:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a7ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186701.815608:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186701.815768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:1.0:1784186701.815800:0:14852:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784186701.815808:0:14852:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1784186701.815895:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784186701.815904:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916011904 00000100:00100000:1.0:1784186701.815913:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916011904 00000100:00100000:1.0:1784186701.815963:0:14853:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1784186701.815971:0:14853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916012032 00000100:00100000:1.0:1784186701.815974:0:14853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916012032 00000100:00100000:1.0:1784186701.816909:0:16343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:1.0:1784186701.816923:0:16343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5561563b-3fe0-476e-ab26-5c9f200a5d15+17:2355:x1870854916011520:12345-192.168.201.31@tcp:4:dd.0 00010000:00010000:1.0:1784186701.816963:0:16343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac2e4b42/0x55bc3e8c99d1a7b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.816982:0:16343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186701.816986:0:16343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186701.816994:0:16343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2e4b42/0x55bc3e8c99d1a7b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186701.817007:0:16343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac2e4b42/0x55bc3e8c99d1a7b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784186702.021026:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:2.0:1784186702.021051:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:2.0:1784186702.021058:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1784186702.021087:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:1.0:1784186702.021347:0:14851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1784186702.021352:0:14851:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1784186700 -> 1784186701 00002000:00010000:1.0:1784186702.021355:0:14851:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784186700 -> 1784186701 00002000:00010000:1.0:1784186702.021357:0:14851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:1.0:1784186702.021371:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a7a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186702.021385:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a7a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186702.021393:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a7a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186702.021399:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17a00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:1.0:1784186702.021411:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a7a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186702.021420:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a7a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186702.021457:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a7a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186702.021465:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003708fd0d/0x55bc3e8c99d1a7a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784186702.021622:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+21:2354:x1870854916011264:12345-192.168.201.31@tcp:4:dd.0 Request processed in 280084us (280495us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1784186702.021634:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 0 00000100:00100000:1.0:1784186702.021691:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 4 00000100:00100000:1.0:1784186702.021705:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec6313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+20:2355:x1870854916011648:12345-192.168.201.31@tcp:4:dd.0 00010000:00010000:1.0:1784186702.021753:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a7bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186702.021765:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186702.021769:0:14851:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784186702.021775:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a7bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784186702.021786:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a7bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784186702.155179:0:16342:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:2.0:1784186702.155189:0:16342:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 8199 00010000:00010000:2.0:1784186702.155205:0:16342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a7ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.155219:0:16342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a7ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.155228:0:16342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a7ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.155236:0:16342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fbe00 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186702.155242:0:16342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a7ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.155251:0:16342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a7ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.155272:0:16342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a7ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.155292:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb4f7d79/0x55bc3e8c99d1a7ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186702.155488:0:16343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac2e4b42/0x55bc3e8c99d1a7b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186702.155498:0:16343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac2e4b42/0x55bc3e8c99d1a7b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186702.155506:0:16343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac2e4b42/0x55bc3e8c99d1a7b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186702.155511:0:16343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5c200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:3.0:1784186702.155515:0:16343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2e4b42/0x55bc3e8c99d1a7b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186702.155522:0:16343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac2e4b42/0x55bc3e8c99d1a7b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186702.155533:0:16343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac2e4b42/0x55bc3e8c99d1a7b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186702.155541:0:16343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac2e4b42/0x55bc3e8c99d1a7b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186702.155663:0:16341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da1b7e0/0x55bc3e8c99d1a7a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186702.155672:0:16341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da1b7e0/0x55bc3e8c99d1a7a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186702.155679:0:16341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da1b7e0/0x55bc3e8c99d1a7a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186702.155685:0:16341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fb600 already unused, calling callback (ffffffffc1768230) 00010000:00010000:0.0:1784186702.155688:0:16341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da1b7e0/0x55bc3e8c99d1a7a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186702.155695:0:16341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da1b7e0/0x55bc3e8c99d1a7a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186702.155705:0:16341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da1b7e0/0x55bc3e8c99d1a7a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186702.155712:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da1b7e0/0x55bc3e8c99d1a7a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186702.156026:0:16342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5561563b-3fe0-476e-ab26-5c9f200a5d15+20:2355:x1870854916011392:12345-192.168.201.31@tcp:4:dd.0 Request processed in 346847us (401611us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1784186702.156054:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 2 00000100:00100000:2.0:1784186702.156091:0:16342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 5 00000100:00100000:2.0:1784186702.156103:0:16342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5561563b-3fe0-476e-ab26-5c9f200a5d15+19:2355:x1870854916011776:12345-192.168.201.31@tcp:4:dd.0 00010000:00010000:2.0:1784186702.156137:0:16342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf011a17/0x55bc3e8c99d1a7c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.156152:0:16342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186702.156156:0:16342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784186702.156163:0:16342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf011a17/0x55bc3e8c99d1a7c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.156175:0:16342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf011a17/0x55bc3e8c99d1a7c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784186702.159861:0:16343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5561563b-3fe0-476e-ab26-5c9f200a5d15+19:2355:x1870854916011520:12345-192.168.201.31@tcp:4:dd.0 Request processed in 342925us (405350us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1784186702.159879:0:16343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 3 00000100:00100000:3.0:1784186702.159919:0:16343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 6 00000100:00100000:3.0:1784186702.159947:0:16343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5561563b-3fe0-476e-ab26-5c9f200a5d15+18:2355:x1870854916011904:12345-192.168.201.31@tcp:4:dd.0 00010000:00010000:3.0:1784186702.159988:0:16343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a7ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186702.160006:0:16343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186702.160011:0:16343:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784186702.160020:0:16343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a7ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784186702.160034:0:16343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a7ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784186702.160333:0:16341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fd11b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5561563b-3fe0-476e-ab26-5c9f200a5d15+19:2354:x1870854916011136:12345-192.168.201.31@tcp:4:dd.0 Request processed in 403329us (419147us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1784186702.160348:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 1 00000100:00100000:0.0:1784186702.160381:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 7 00000100:00100000:0.0:1784186702.160390:0:16341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5561563b-3fe0-476e-ab26-5c9f200a5d15+18:2355:x1870854916012032:12345-192.168.201.31@tcp:4:dd.0 00010000:00010000:0.0:1784186702.160410:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a7d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186702.160421:0:16341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186702.160424:0:16341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784186702.160429:0:16341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a7d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784186702.160462:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a7d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784186702.162574:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:3.0:1784186702.162608:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:3.0:1784186702.207856:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:2.0:1784186702.213542:0:14851:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:2.0:1784186702.213553:0:14851:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 16391 00010000:00010000:2.0:1784186702.213569:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a7bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.213583:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a7bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.213591:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a7bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.213599:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffcc5d200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186702.213625:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a7bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.213635:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a7bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.213657:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a7bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.213665:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe88506a/0x55bc3e8c99d1a7bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186702.213767:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec6313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+17:2355:x1870854916011648:12345-192.168.201.31@tcp:4:dd.0 Request processed in 192063us (459219us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1784186702.213777:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 4 00010000:00010000:2.0:1784186702.251185:0:16341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a7d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251208:0:16341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a7d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251218:0:16341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a7d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251226:0:16341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ec58fa200 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186702.251231:0:16341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a7d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251620:0:16341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a7d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251646:0:16341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a7d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251654:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a80b6992/0x55bc3e8c99d1a7d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186702.251799:0:16341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5561563b-3fe0-476e-ab26-5c9f200a5d15+15:2355:x1870854916012032:12345-192.168.201.31@tcp:4:dd.0 Request processed in 91405us (436025us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1784186702.251811:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 7 00010000:00010000:2.0:1784186702.251868:0:16343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a7ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251877:0:16343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a7ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251885:0:16343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a7ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251891:0:16343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9ffdf17000 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186702.251894:0:16343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a7ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251914:0:16343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a7ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251926:0:16343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a7ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.251933:0:16343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065ae6f19/0x55bc3e8c99d1a7ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186702.251967:0:16343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5561563b-3fe0-476e-ab26-5c9f200a5d15+13:2355:x1870854916011904:12345-192.168.201.31@tcp:4:dd.0 Request processed in 92025us (436372us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1784186702.251973:0:16343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 6 00010000:00010000:2.0:1784186702.252011:0:16342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf011a17/0x55bc3e8c99d1a7c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.252020:0:16342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf011a17/0x55bc3e8c99d1a7c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.252027:0:16342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf011a17/0x55bc3e8c99d1a7c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.252032:0:16342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b9fc766c400 already unused, calling callback (ffffffffc1768230) 00010000:00010000:2.0:1784186702.252035:0:16342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf011a17/0x55bc3e8c99d1a7c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.252052:0:16342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf011a17/0x55bc3e8c99d1a7c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.252062:0:16342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf011a17/0x55bc3e8c99d1a7c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784186702.252069:0:16342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf011a17/0x55bc3e8c99d1a7c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784186702.252106:0:16342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5561563b-3fe0-476e-ab26-5c9f200a5d15+11:2355:x1870854916011776:12345-192.168.201.31@tcp:4:dd.0 Request processed in 96007us (447564us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1784186702.252114:0:16342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 5 00000001:00080000:2.0:1784186702.252142:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:2.0:1784186702.252158:0:6607:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00000040:00080000:3.0:1784186702.334038:0:14246:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784186702.334049:0:14246:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784186702.334109:0:14246:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1784186702.334116:0:14246:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1784186702.593153:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784186703.188538:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186703.188656:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186703.188693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186703.188732:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186703.188754:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186703.188773:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:3.0:1784186703.188830:0:16338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916012800 00000100:00100000:2.0:1784186703.188830:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916012544 00000100:00100000:3.0:1784186703.188841:0:16338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916012800 00000100:00100000:2.0:1784186703.188842:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916012544 00000100:00100000:2.0:1784186703.188903:0:14845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916012416 00000100:00100000:2.0:1784186703.188908:0:14845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916012416 00000100:00100000:0.0:1784186703.199909:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.31@tcp (source: 12345-192.168.201.31@tcp) 00000100:00100000:0.0:1784186703.199996:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916012160 00000100:00100000:0.0:1784186703.200007:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916012160 00000100:00100000:0.0:1784186703.200067:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:0.0:1784186703.200077:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+13:2354:x1870854916012160:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186703.200161:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a817dd11-5739-48aa-94ad-59c5eb22f761+13:2354:x1870854916012160:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 85us (11428us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186703.200185:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 123 00000100:00100000:0.0:1784186703.200219:0:14848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916012928 00000100:00100000:0.0:1784186703.200223:0:14848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916012928 00000100:00100000:3.0:1784186703.203684:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:3.0:1784186703.203709:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2354:x1870854916012544:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186703.203809:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2354:x1870854916012544:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 110us (15153us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186703.203816:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 12 00000100:00100000:3.0:1784186703.203870:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00100000:3.0:1784186703.203893:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2354:x1870854916012800:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:3.0:1784186703.203924:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2354:x1870854916012800:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 32us (15230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784186703.203929:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 13 00000100:00080000:3.0:1784186703.203968:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784186703.203973:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784186703.205330:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:2.0:1784186703.205341:0:14847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2354:x1870854916012416:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:2.0:1784186703.205414:0:14847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5561563b-3fe0-476e-ab26-5c9f200a5d15+5:2354:x1870854916012416:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 76us (16658us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186703.205421:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 14 00000100:00100000:1.0:1784186703.208391:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916012288 00000100:00100000:1.0:1784186703.208409:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916012288 00000100:00100000:1.0:1784186703.208549:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854916012672 00000100:00100000:1.0:1784186703.208553:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854916012672 00000100:00100000:1.0:1784186703.208580:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:1.0:1784186703.208589:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+20:2354:x1870854916012288:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186703.208680:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5561563b-3fe0-476e-ab26-5c9f200a5d15+20:2354:x1870854916012288:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 92us (20156us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186703.208687:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 27 00000100:00100000:1.0:1784186703.208710:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:1.0:1784186703.208716:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ffe311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:2354:x1870854916012672:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:1.0:1784186703.208747:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ffe311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2758468b-7a8c-4a51-b99e-f874fcc4fd95+6:2354:x1870854916012672:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 28us (19970us total) trans 0 rc 0/0 00000100:00100000:1.0:1784186703.208753:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 28 00000100:00100000:0.0:1784186703.211187:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00100000:0.0:1784186703.211203:0:14848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fc9c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2354:x1870854916012928:12345-192.168.201.31@tcp:400:kworker.0 00000100:00100000:0.0:1784186703.211299:0:14848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9fc9c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2758468b-7a8c-4a51-b99e-f874fcc4fd95+5:2354:x1870854916012928:12345-192.168.201.31@tcp:400:kworker.0 Request processed in 100us (11413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784186703.211306:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.31@tcp, seq: 15 00000100:00080000:2.0:1784186703.211596:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784186703.613626:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784186704.216239:0:16381:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1784186704.637743:0:14200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784186705.598591:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854938012288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784186705.598657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186705.598794:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938012288 00000100:00100000:2.0:1784186705.598802:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938012288 00000100:00100000:2.0:1784186705.598869:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784186705.598878:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9ec71ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854938012288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784186705.598914:0:14850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1784186705.598974:0:14850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9b9ec71ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854938012288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784186705.598982:0:14850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784186705.599017:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1784186705.599022:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b9fd11b5c00, transno 8589934595 00000004:00080000:2.0:1784186705.599032:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1784186705.599058:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9b9fd11b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854938012288:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784186705.599406:0:14208:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784186705.667865:0:14201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784186706.109614:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1870854938012928:0@lo:400:kworker.0 00000100:00100000:2.0:1784186706.109688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186706.109745:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1784186706.109751:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fb25396a-5e10-4f60-be9a-8f767a2ae4fa:3306:1870854938012416:0@lo:400:kworker.0 00000100:00100000:2.0:1784186706.109779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186706.109799:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fc9c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1870854938012544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784186706.109823:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186706.109840:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1870854938013056:0@lo:400:kworker.0 00000100:00100000:2.0:1784186706.109859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186706.109884:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1870854938012672:0@lo:400:kworker.0 00000100:00100000:2.0:1784186706.109906:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186706.109922:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784186706.109927:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9b9fd11b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1870854938012800:0@lo:400:kworker.0 00000100:00100000:2.0:1784186706.109959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784186706.109992:0:14850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870854938012544 00000100:00100000:2.0:1784186706.109999:0:14850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870854938012544 00000100:00100000:2.0:1784186706.110054:0:14850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784186706.110064:0:14850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9b9fd11b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1870854938012544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784186706.110099:0:14850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 Debug log: 29474 lines, 29474 kept, 0 dropped, 0 bad.